Jing Yu Koh
Jing Yu Koh has 2 papers in our library, in 2024, most of them on Vision & language; often with Daniel Fried, Graham Neubig, Robert Lo.
OpenAlex · h-index 13 · 31 works · 1,165 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 330 times in our library · 9 more in our library without a page yet · ⭐ Paper Stars ranking: #6011
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksInformation Systems · 2 worksArts and Humanities · 1 workComputer Vision and Pattern Recognition · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Vision & language · 1 work
Works by year
2020s
Papers
- VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks (2024 · 184 citations)
Most benchmarks for autonomous web agents rely on text alone. Many everyday web tasks, however, depend on what a page or a reference picture looks like. VisualWebArena addresses this gap. It is a benchmark that extends the WebArena framework with tasks that cannot be solved without visual understanding. - Tree Search for Language Model Agents (2024 · 61 citations)
Language-model web agents still fall far short of people on realistic browsing tasks. Humans solve 78% of WebArena tasks and 89% of VisualWebArena tasks, while agents usually stay under 20%. The authors argue that a major cause is that agents commit to one action at a time and cannot spend extra inference compute…
All works
- VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Jing Yu Koh, Robert Lo, Lawrence Jang, et al.2024 · 184 citations
- Grounding Language Models to Images for Multimodal Inputs and Outputs ↗arXiv (Cornell University) · no summary yetJing Yu Koh, Ruslan Salakhutdinov, Daniel Fried2023 · 82 citations
- Tree Search for Language Model AgentsarXiv:2407.01476Jing Yu Koh, Stephen McAleer, Daniel Fried, et al.2024 · 61 citations
- OmniACT: A Dataset and Benchmark for Enabling Multimodal Generalist Autonomous Agents for Desktop and Web ↗Lecture notes in computer science · no summary yetRaghav Kapoor et al.2024 · 60 citations
- Dissecting Adversarial Robustness of Multimodal LM Agents ↗arXiv (Cornell University) · no summary yetChen Henry Wu et al.2024 · 20 citations
- Odysseys: Benchmarking Web Agents on Realistic Long Horizon Tasks ↗arXiv (Cornell University) · no summary yetLawrence Jang et al.2026 · 3 citations
- Multimodal Graph Learning for Generative Tasks ↗arXiv (Cornell University) · no summary yetMinji Yoon et al.2023 · 2 citations
- iOSWorld: A Benchmark for Personally Intelligent Phone Agents ↗arXiv (Cornell University) · no summary yetLawrence Jang et al.2026 · 1 citation
- MyPCBench: A Benchmark for Personally Intelligent Computer-Use Agents ↗arXiv (Cornell University) · no summary yetLawrence Jang et al.2026 · 1 citation
- cua-speedrun: Standardized Benchmarking of the Speed of Computer-Use Agents ↗arXiv (Cornell University) · no summary yetPranjal Aggarwal et al.2026
- Multi-Agent Computer Use ↗arXiv (Cornell University) · no summary yetJing Yu Koh, Ruslan Salakhutdinov, Daniel Fried2026
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2024
- Lecture notes in computer science
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jing-yu-koh/