Elamur Research⌕
☰
home / papers / 2026 / LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey

LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey

Paper · 2026 · Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu et al.

Summary

Fully autonomous LLM agents remain hard to trust in practice. They hallucinate, especially across chained actions. They also falter on long, expertise-heavy tasks and raise safety, bias and accountability concerns in areas such as finance or healthcare. This survey argues for keeping people in the loop and gives what the authors call the first structured overview of LLM-based human-agent systems (LLM-HAS). In these systems, humans supply missing information, critique or correct outputs, or take control when stakes are high.

The authors build a taxonomy with five dimensions: environment and profiling, human feedback, interaction type, orchestration, and communication. They use it to classify existing work. They also compare three ways of building such systems: prompting, supervised fine-tuning and reinforcement learning. Finally, they collect benchmarks across domains and discuss open problems, including variability in human behaviour, agent-centric designs, weak evaluation practices and safety gaps.

The result is a shared vocabulary and reference map for designing and assessing collaborative agents. It is backed by a maintained GitHub list of papers and resources.

Key points

  • Human feedback is grouped along three axes:
    • type: evaluative, corrective, guidance or implicit;
    • granularity: holistic or segment-level;
    • timing: initial, during or post task.
    • Examples cited include Uni-RLHF, PRELUDE, Self-Refine, VeriPlan and AgentA/B.
  • Interaction types cover collaboration (delegation, supervision, coordination, cooperation), competition and coopetition. Orchestration is split into one-by-one vs. simultaneous execution and synchronous vs. asynchronous timing.
  • Communication is characterized by its mode, which can be observation, conversation or a shared message pool, and by its organization, which may be hierarchical, centralized or decentralized. Users are profiled as "lazy" or "informative."
  • Implementation trade-offs differ by approach:
    • SFT methods (PRELUDE, XtraGPT, CollabLLM) yield steadier behaviour at a higher data cost.
    • RL methods (UserRL, MUA-RL, SWEET-RL, ReHAC) handle long horizons but struggle with reward design.
    • Hybrid pipelines combining these approaches are increasingly common.
  • Benchmarks span embodied AI, coding, web navigation, healthcare, retail, travel and finance. Examples include MINT, WebLINX, ColBench, ConvCodeWorld, τ-Bench, τ2-Bench, UserBench and InterruptBench. The repository is Awesome-Human-Agent-Collaboration-Interaction-Systems.

Our summary of the paper, in our own words — not its text. The work belongs to its authors; read it at the links above.

 Institutions

 Fields, topics and concepts

Cite

Cite as Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang and Philip S. Yu. 2026. LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey. Findings of the Association for Computational Linguistics: ACL 2026.

The paper itself, not this page. BibTeX from the library's record of the work. DOI 10.18653/v1/2026.findings-acl.1811

@inproceedings{zou2026llm,
  title = {{LLM-Based Human-Agent Collaboration and Interaction Systems: A Survey}},
  author = {Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Jizhou Guo, Yankai Chen, Chunyu Miao, Hoang H Nguyen, Yue Zhou, Weizhi Zhang, Liancheng Fang, Hanrong Zhang, Fangxin Wang, Pengfei Zhang, Langzhou He, Yangning Li, Dongyuan Li, Renhe Jiang and Philip S. Yu},
  booktitle = {Findings of the Association for Computational Linguistics: ACL 2026},
  year = {2026},
  doi = {10.18653/v1/2026.findings-acl.1811},
  url = {https://doi.org/10.18653/v1/2026.findings-acl.1811}
}

References

144 references, 13 of them with a card of ours. ↗ leads to the work, «find» searches for one we have no id for yet.

  1. Adem Ait, Javier Luis Cánovas Izquierdo, and Jordi Cabot. 2024. Towards modeling human-agentic collaborative workflows: A bpmn extension. arXiv preprint arXiv:2412.05958. — [arXiv:2412.05958](https://arxiv.org/abs/2412.05958) find
  2. Hao Bai, Yifei Zhou, Mert Cemri, Jiayi Pan, Alane Suhr, Sergey Levine, and Aviral Kumar. 2024. Digirl: Training in-the-wild device-control agents with autonomous reinforcement learning. In Advances in Neural Information Processing Systems, volume 37, pages 12461–12495. Curran Associates, Inc. find
  3. Gagan Bansal, Jennifer Wortman Vaughan, Saleema Amershi, Eric Horvitz, Adam Fourney, Hussein Mozannar, Victor Dibia, and Daniel S Weld. 2024. Challenges in human-agent communication. arXiv preprint arXiv:2412.10380. — [arXiv:2412.10380](https://arxiv.org/abs/2412.10380) find
  4. Victor Barres, Honghua Dong, Soham Ray, Xujie Si, and Karthik Narasimhan. 2025. τ 2-bench: Evaluating conversational agents in a dual-control environment. ArXiv, abs/2506.07982. find
  5. Uwe M Borghoff, Paolo Bottoni, and Remo Pareschi. 2025. Human-artificial interaction in the age of agentic ai: a system-theoretical approach. Frontiers in Human Dynamics, 7:1579166. find
  6. Matthew Chang, Gunjan Chhablani, Alexander Clegg, Mikael Dallaire Cote, Ruta Desai, Michal Hlavac, Vladimir Karashchuk, Jacob Krantz, Roozbeh Mottaghi, Priyam Parashar, and 1 others. 2024. Partnr: A benchmark for planning and reasoning in embodied multi-agent tasks. arXiv preprint arXiv:2411.00081. — [arXiv:2411.00081](https://arxiv.org/abs/2411.00081) find
  7. Shreyas Chaudhari, Pranjal Aggarwal, Vishvak Murahari, Tanmay Rajpurohit, Ashwin Kalyan, Karthik Narasimhan, Ameet Deshpande, and Bruno Castro da Silva. 2024. Rlhf deciphered: A critical analysis of reinforcement learning from human feedback for llms. arXiv preprint arXiv:2404.08555. — [arXiv:2404.08555](https://arxiv.org/abs/2404.08555) find
  8. Minghao Chen, Yihang Li, Yanting Yang, Shiyu Yu, Binbin Lin, and Xiaofei He. 2024a. Automanual: Generating instruction manuals by LLM agents via interactive environmental learning. In The Thirty-eighth Annual Conference on Neural Information Processing Systems. find
  9. Nuo Chen, Andre Lin Huikai, Jiaying Wu, Junyi Hou, Zining Zhang, Qian Wang, Xidong Wang, and Bingsheng He. 2025a. Xtragpt: Context-aware and controllable academic paper revision. find
  10. Yankai Chen, Xinni Zhang, Yifei Zhang, Yangning Li, Henry Peng Zou, Chunyu Miao, Weizhi Zhang, Xue Liu, and Philip S Yu. 2025b. Embracing trustworthy brain-agent collaboration as paradigm extension for intelligent assistive technologies. arXiv preprint arXiv:2510.22095. — [arXiv:2510.22095](https://arxiv.org/abs/2510.22095) find
  11. Ying-Jung Chen, Chi-Sheng Chen, and Ahmad Albar-qawi. 2025c. Reinforcing clinical decision support through multi-agent systems and ethical ai governance. arXiv preprint arXiv:2504.03699. — [arXiv:2504.03699](https://arxiv.org/abs/2504.03699) find
  12. Yixin Chen, Guoxi Zhang, Yaowei Zhang, Hongming Xu, Peiyuan Zhi, Qing Li, and Siyuan Huang. 2024b. Synergai: Perception alignment for human-robot collaboration. arXiv preprint arXiv:2409.15684. — [arXiv:2409.15684](https://arxiv.org/abs/2409.15684) find
  13. Sanjiban Choudhury and Paloma Sodhi. 2025. Better than your teacher: LLM agents that learn from privileged AI feedback. In The Thirteenth International Conference on Learning Representations. find
  14. Michelle Cohn, Mahima Pushkarna, Gbolahan O Olanubi, Joseph M Moran, Daniel Padgett, Zion Mengesha, and Courtney Heldreth. 2024. Believing anthropomorphism: examining the role of anthropomorphic cues on trust in large language models. In Extended Abstracts of the CHI Conference on Human Factors in C… find
  15. Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye, and Ziran Wang. 2024. Drive as you speak: Enabling human-like interaction with large language models in autonomous vehicles. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, pages 902–909. find
  16. Chengyuan Deng, Yiqun Duan, Xin Jin, Heng Chang, Yijun Tian, Han Liu, Yichen Wang, Kuofeng Gao, Henry Peng Zou, Yiqiao Jin, Yijia Xiao, Shenghao Wu, Zongxing Xie, Weimin Lyu, Sihong He, Lu Cheng, Haohan Wang, and Jun Zhuang. 2024. Deconstructing The Ethics of Large Language Models from Long-standing… — [arXiv:2406.05392](https://arxiv.org/abs/2406.05392) find
  17. Danny Driess, Fei Xia, Mehdi S. M. Sajjadi, Corey Lynch, Aakanksha Chowdhery, Brian Ichter, Ayzaan Wahid, Jonathan Tompson, Quan Vuong, Tianhe Yu, Wenlong Huang, Yevgen Chebotar, Pierre Sermanet, Daniel Duckworth, Sergey Levine, Vincent Vanhoucke, Karol Hausman, Marc Toussaint, Klaus Greff, and 3 ot… find
  18. Jiangshu Du, Yibo Wang, Wenting Zhao, Zhongfen Deng, Shuaiqi Liu, Renze Lou, Henry Peng Zou, Pranav Narayanan Venkit, Nan Zhang, Mukund Srinath, Haoran Ranran Zhang, Vipul Gupta, Yinghui Li, Tao Li, Fei Wang, Qin Liu, Tianlin Liu, Pengzhi Gao, Congying Xia, and 21 others. 2024. LLMs assist NLP resea…
  19. Subhabrata Dutta, Timo Kaufmann, Goran Glavaš, Ivan Habernal, Kristian Kersting, Frauke Kreuter, Mira Mezini, Iryna Gurevych, Eyke Hüllermeier, and Hinrich Schuetze. 2024. Problem solving through human-ai preference-based cooperation. arXiv preprint arXiv:2408.07461.
  20. Selin S Everett, Bryan J Bunning, Priyank Jain, Ivan Lopez, Anup Agarwal, Manisha Desai, Robert Gallo, Ethan Goh, Vinay B Kadiyala, Zahir Kanjee, and 1 others. 2025. From tool to teammate: A randomized controlled trial of clinician-ai collaborative workflows for diagnosis. MedRxiv. find
  21. Xueyang Feng, Zhi-Yuan Chen, Yujia Qin, Yankai Lin, Xu Chen, Zhiyuan Liu, and Ji-Rong Wen. 2024. Large language model-based human-agent collaboration for complex task solving. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 1336–1357, Miami, Florida, USA. Association… find
  22. George Fragiadakis, Christos Diou, George Kousiouris, and Mara Nikolaidou. 2024. Evaluating human-ai collaboration: A review and methodological framework. arXiv preprint arXiv:2407.19098. — [arXiv:2407.19098](https://arxiv.org/abs/2407.19098) find
  23. Ge Gao, Alexey Taymanov, Eduardo Salinas, Paul Mineiro, and Dipendra Misra. 2024a. Aligning LLM agents by learning latent preference from user edits. In The Thirty-eighth Annual Conference on Neural Information Processing Systems. find
  24. Jie Gao, Simret Araya Gebreegziabher, Kenny Tsu Wei Choo, Toby Jia-Jun Li, Simon Tangi Perrault, and Thomas W Malone. 2024b. A taxonomy for human-llm interaction modes: An initial exploration. In Extended Abstracts of the CHI Conference on Human Factors in Computing Systems, pages 1–11. find
  25. Yiming Gao, Feiyu Liu, Liang Wang, Zhenjie Lian, Dehua Zheng, Weixuan Wang, Wenjin Yang, Siqin Li, Xianliang Wang, Wenhui Chen, and 1 others. 2024c. Enhancing human experience in human-agent collaboration: A human-centered modeling approach based on positive human gain. arXiv preprint arXiv:2401.164… — [arXiv:2401.16444](https://arxiv.org/abs/2401.16444) find
  26. Christos Gkournelos, Christos Konstantinou, and Sotiris Makris. 2024. An llm-based approach for enabling seamless human-robot collaboration in assembly. CIRP Annals, 73(1):9–12. find
  27. Moshe Glickman and Tali Sharot. 2025. How human–ai feedback loops alter human perceptual, emotional and social judgements. Nature Human Behaviour, 9(2):345–359. find
  28. Ran Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-Chun Zhu, Demetri Terzopoulos, Li Fei-Fei, and 1 others. 2023. Mindagent: Emergent gaming interaction. arXiv preprint arXiv:2309.09971. find
  29. Diego Gosmar and Deborah A Dahl. 2025. Hallucination mitigation using agentic ai natural language-based frameworks. arXiv preprint arXiv:2501.13946. — [arXiv:2501.13946](https://arxiv.org/abs/2501.13946) find
  30. Junliang Guo, Yang Ye, Tianyu He, Haoyu Wu, Yushu Jiang, Tim Pearce, and Jiang Bian. 2025. Mineworld: a real-time and open-source interactive world model on minecraft. arXiv preprint arXiv:2504.08388. — [arXiv:2504.08388](https://arxiv.org/abs/2504.08388) find
  31. Taicheng Guo, Xiuying Chen, Yaqi Wang, Ruidi Chang, Shichao Pei, Nitesh V Chawla, Olaf Wiest, and Xiangliang Zhang. 2024a. Large language model based multi-agents: a survey of progress and challenges. In Proceedings of the Thirty-Third International Joint Conference on Artificial Intelligence, pages…
  32. Xudong Guo, Kaixuan Huang, Jiale Liu, Wenhui Fan, Natalia Vélez, Qingyun Wu, Huazheng Wang, Thomas L. Griffiths, and Mengdi Wang. 2024b. Embodied LLM agents learn to cooperate in organized teams. In Language Gamification - NeurIPS 2024 Workshop. find
  33. Hojae Han, Seung-won Hwang, Rajhans Samdani, and Yuxiong He. 2025. Convcodeworld: Benchmarking conversational code generation in reproducible feedback environments. arXiv preprint arXiv:2502.19852. — [arXiv:2502.19852](https://arxiv.org/abs/2502.19852) find
  34. Allyson I Hauptman, Beau G Schelble, Nathan J Mc-Neese, and Kapil Chalil Madathil. 2023. Adapt and overcome: Perceptions of adaptive autonomous agents for human-ai teaming. Computers in Human Behavior, 138:107451. find
  35. Yufei He, Ruoyu Li, Alex Chen, Yue Liu, Yulin Chen, Yuan Sui, Cheng Chen, Yi Zhu, Luca Luo, Frank Yang, and Bryan Hooi. 2025. Enabling self-improving agents to learn at test time with human-in-the-loop guidance. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processin… find
  36. Sirui Hong, Xiawu Zheng, Jonathan Chen, Yuheng Cheng, Jinlin Wang, Ceyao Zhang, Zili Wang, Steven Ka Shing Yau, Zijuan Lin, Liyang Zhou, and 1 others. 2023. Metagpt: Meta programming for multi-agent collaborative framework. arXiv preprint arXiv:2308.00352, 3(4):6.
  37. Wei-Chieh Huang, Weizhi Zhang, Yueqing Liang, Yuanchen Bei, Yankai Chen, Tao Feng, Xinyu Pan, Zhen Tan, Yu Wang, Tianxin Wei, and 1 others. 2026. Rethinking memory mechanisms of foundation agents in the second half. arXiv preprint arXiv:2602.06052. — [arXiv:2602.06052](https://arxiv.org/abs/2602.06052) find
  38. Wei-Chieh Huang, Henry Peng Zou, Yaozu Wu, Dongyuan Li, Yankai Chen, Weizhi Zhang, Yangning Li, Angelo Zangari, Jizhou Guo, Chunyu Miao, and 1 others. 2025. Deepresearchguard: Deep research with open-domain evaluation and multi-stage guardrails for safety. arXiv preprint arXiv:2510.10994. find
  39. Faria Huq, Zora Zhiruo Wang, Frank F. Xu, Tianyue Ou, Shuyan Zhou, Jeffrey P. Bigham, and Graham Neubig. 2025. Cowpilot: A framework for autonomous and human-agent collaborative web navigation. Preprint, arXiv:2501.16609. find
  40. Guanxuan Jiang, Yuyang Wang, and Pan Hui. 2025. Experimental exploration: Investigating cooperative interaction behavior between humans and large language model agents. Preprint, arXiv:2503.07320. — [arXiv:2503.07320](https://arxiv.org/abs/2503.07320) find
  41. Yucheng Jiang, Yijia Shao, Dekun Ma, Sina Semnani, and Monica Lam. 2024. Into the unknown unknowns: Engaged human learning through participation in language model agent conversations. In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 9917–9955, Miami, F… find
  42. Seth Karten, Mycal Tucker, Huao Li, Siva Kailas, Michael Lewis, and Katia Sycara. 2023. Interpretable learned emergent communication for human– agent teams. IEEE Transactions on Cognitive and Developmental Systems, 15(4):1801–1811. find
  43. Michael Kelly, Chelsea Sidrane, Katherine Driggs-Campbell, and Mykel J Kochenderfer. 2019. Hg-dagger: Interactive imitation learning with human experts. In 2019 International Conference on Robotics and Automation (ICRA), pages 8077–8083. IEEE. find
  44. D Roderick Kiewiet and Mathew D McCubbins. 1991. The logic of delegation. University of Chicago Press. find
  45. Been Kim, John Hewitt, Neel Nanda, Noah Fiedel, and Oyvind Tafjord. 2025a. Because we have llms, we can and should pursue agentic interpretability. arXiv preprint arXiv:2506.12152. — [arXiv:2506.12152](https://arxiv.org/abs/2506.12152) find
  46. JiWoo Kim, Minsuk Chang, and JinYeong Bak. 2025b. Beyond turn-taking: Introducing text-based overlap into human-llm interactions. arXiv preprint arXiv:2501.18103. — [arXiv:2501.18103](https://arxiv.org/abs/2501.18103) find
  47. Christine Lee, David J. Porfirio, Xinyu Jessica Wang, Kevin Zhao, and Bilge Mutlu. 2025a. Veriplan: Integrating formal verification and llms into end-user planning. ArXiv, abs/2502.17898. — [arXiv:2502.17898](https://arxiv.org/abs/2502.17898) find
  48. Dong Won Lee, Yubin Kim, Denison Guvenoz, Sooyeon Jeong, Parker Malachowsky, Louis-Philippe Morency, Cynthia Breazeal, and Hae Won Park. 2025b. The human robot social interaction (hsri) dataset: Benchmarking foundational models’ social reasoning. arXiv preprint arXiv:2504.13898. — [arXiv:2504.13898](https://arxiv.org/abs/2504.13898) find
  49. Ido Levy, Ben Wiesel, Sami Marreed, Alon Oved, Avi Yaeli, and Segev Shlomov. 2024. St-webagentbench: A benchmark for evaluating safety and trustworthiness in web agents. arXiv preprint arXiv:2410.06703. — [arXiv:2410.06703](https://arxiv.org/abs/2410.06703) find
  50. Xinyi Li, Sai Wang, Siqi Zeng, Yu Wu, and Yi Yang. 2024. A survey on llm-based multi-agent systems: workflow, infrastructure, and challenges. Vicinagearth, 1(1):9. find
  51. Q Vera Liao, Daniel Gruen, and Sarah Miller. 2020. Questioning the ai: informing design practices for explainable ai user experiences. In Proceedings of the 2020 CHI conference on human factors in computing systems, pages 1–15. find
  52. Jonghan Lim, Sujani Patel, Alex Evans, John Pim-ley, Yifei Li, and Ilya Kovalenko. 2024. Enhancing human-robot collaborative assembly in manufacturing systems using large language models. In 2024 IEEE 20th International Conference on Automation Science and Engineering (CASE), pages 2581–2587. find
  53. Haokun Liu, Yaonan Zhu, Kenji Kato, Izumi Kondo, Tadayoshi Aoyama, and Yasuhisa Hasegawa. 2023a. Llm-based human-robot collaboration framework for manipulation tasks. arXiv preprint arXiv:2308.14972. — [arXiv:2308.14972](https://arxiv.org/abs/2308.14972) find
  54. Haokun Liu, Yaonan Zhu, Kenji Kato, Atsushi Tsukahara, Izumi Kondo, Tadayoshi Aoyama, and Yasuhisa Hasegawa. 2024a. Enhancing the llm-based robot manipulation through human-robot collaboration. IEEE Robotics and Automation Letters. find
  55. Haoyang Liu, Yijiang Li, and Haohan Wang. 2025. Genomas: A multi-agent framework for scientific discovery via code-driven gene expression analysis. ArXiv, abs/2507.21035. — [arXiv:2507.21035](https://arxiv.org/abs/2507.21035) find
  56. Jijia Liu, Chao Yu, Jiaxuan Gao, Yuqing Xie, Qingmin Liao, Yi Wu, and Yu Wang. 2023b. Llm-powered hierarchical language agent for real-time human-ai coordination. ArXiv, abs/2312.15224. — [arXiv:2312.15224](https://arxiv.org/abs/2312.15224) find
  57. Shipeng Liu, FNU Shrutika, Boshen Zhang, Zhehui Huang, and Feifei Qian. 2024b. Effect of adaptive communication support on human-ai collaboration. arXiv preprint arXiv:2412.06808. — [arXiv:2412.06808](https://arxiv.org/abs/2412.06808) find
  58. Xiao Liu, Hao Yu, Hanchen Zhang, Yifan Xu, Xuanyu Lei, Hanyu Lai, Yu Gu, Hangliang Ding, Kaiwen Men, Kejuan Yang, and 1 others. 2024c. Agentbench: Evaluating llms as agents. In The Twelfth International Conference on Learning Representations.
  59. Carol Loganbill, Emily Hardy, and Ursula Delworth. 1982. Supervision: A conceptual model. The counseling psychologist, 10(1):3–42. find
  60. Bowen Lou, Tian Lu, Raghu Santanam, and Yingjie Zhang. 2025. Unraveling human-ai teaming: A review and outlook. arXiv preprint arXiv:2504.05755. — [arXiv:2504.05755](https://arxiv.org/abs/2504.05755) find
  61. Ryan Lowe, Yi I Wu, Aviv Tamar, Jean Harb, OpenAI Pieter Abbeel, and Igor Mordatch. 2017. Multi-agent actor-critic for mixed cooperative-competitive environments. Advances in neural information processing systems, 30. find
  62. Junting Lu, Zhiyang Zhang, Fangkai Yang, Jue Zhang, Lu Wang, Chao Du, Qingwei Lin, Saravan Rajmohan, Dongmei Zhang, and Qi Zhang. 2024. Turn every application into an agent: Towards efficient human-agent-computer interaction with api-first llm-based agents. arXiv preprint arXiv:2409.17140. — [arXiv:2409.17140](https://arxiv.org/abs/2409.17140) find
  63. Xing Han Lù, Zdeněk Kasner, and Siva Reddy. 2024. Weblinx: Real-world website navigation with multi-turn dialogue. arXiv preprint arXiv:2402.05930.
  64. Junyu Luo, Weizhi Zhang, Ye Yuan, Yusheng Zhao, Junwei Yang, Yiyang Gu, Bohan Wu, Binqi Chen, Ziyue Qiao, Qingqing Long, and 1 others. 2025. Large language model agent: A survey on methodology, applications and challenges. arXiv preprint arXiv:2503.21460.
  65. Qianou Ma, Dora Zhao, Xinran Zhao, Chenglei Si, Chenyang Yang, Ryan Louie, Ehud Reiter, Diyi Yang, and Tongshuang Wu. 2025. Sphere: An evaluation card for human-ai systems. arXiv preprint arXiv:2504.07971. find
  66. Andrea Madotto, Zhaojiang Lin, Chien-Sheng Wu, and Pascale Fung. 2019. Personalizing dialogue agents via meta-learning. In Proceedings of the 57th annual meeting of the association for computational linguistics, pages 5454–5459.
  67. Nikhil Mehta, Milagro Teruel, Xin Deng, Sergio Figueroa Sanz, Ahmed Awadallah, and Julia Kiseleva. 2024. Improving grounded language understanding in a collaborative environment by interacting with agents through help feedback. In Findings of the Association for Computational Linguistics: EACL 2024,… find
  68. Yannick Metz, David Lindner, Raphaël Baur, and Mennatallah El-Assady. 2024. Mapping out the space of human feedback for reinforcement learning: A conceptual framework. arXiv preprint arXiv:2411.11761. — [arXiv:2411.11761](https://arxiv.org/abs/2411.11761) find
  69. Chunyu Miao, Henry Peng Zou, Yangning Li, Yankai Chen, Yibo Wang, Fangxin Wang, Yifan Li, Wooseong Yang, Bowei He, Xinni Zhang, and 1 others. 2025. Recode-h: A benchmark for research code development with interactive human feedback. arXiv preprint arXiv:2510.06186. — [arXiv:2510.06186](https://arxiv.org/abs/2510.06186) find
  70. Margaret Mitchell, Avijit Ghosh, Alexandra Sasha Luccioni, and Giada Pistilli. 2025. Fully autonomous ai agents should not be developed. arXiv preprint arXiv:2502.02649. — [arXiv:2502.02649](https://arxiv.org/abs/2502.02649) find
  71. Hussein Mozannar, Gagan Bansal, Cheng Tan, Adam Fourney, Victor Dibia, Jingya Chen, Jack Gerrits, Tyler Payne, Matheus Kunzler Maldaner, Madeleine Grunde-McLaughlin, Eric Zhu, Griffin Bassman, Jacob Alber, Peter Chang, Ricky Loynd, Friederike Niedtner, Ece Kamar, Maya Murad, Rafah Hosn, and Saleema… — [arXiv:2507.22358](https://arxiv.org/abs/2507.22358) find
  72. Anirban Mukherjee and Hannah Hanwen Chang. 2025. Stochastic, dynamic, fluid autonomy in agentic ai: Implications for authorship, inventorship, and liability. arXiv preprint arXiv:2504.04058. — [arXiv:2504.04058](https://arxiv.org/abs/2504.04058) find
  73. Sheshera Mysore, Debarati Das, Hancheng Cao, and Bahareh Sarrafzadeh. 2025. Prototypical human-AI collaboration behaviors from LLM-assisted writing in the wild. In Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing, pages 16830–16857, Suzhou, China. Association fo… find
  74. Riya Naik, Ashwin Srinivasan, Estrid He, and Swati Agarwal. 2025. An empirical study of the role of incompleteness and ambiguity in interactions with large language models. arXiv preprint arXiv:2503.17936. — [arXiv:2503.17936](https://arxiv.org/abs/2503.17936) find
  75. Sriraam Natarajan, Saurabh Mathur, Sahil Sidheekh, Wolfgang Stammer, and Kristian Kersting. 2025. Human-in-the-loop or ai-in-the-loop? automate or collaborate? In Proceedings of the AAAI Conference on Artificial Intelligence, volume 39, pages 28594– 28600. find
  76. Bo Pan, Jiaying Lu, Ke Wang, Li Zheng, Zhen Wen, Yingchaojie Feng, Minfeng Zhu, and Wei Chen. 2024a. Agentcoord: Visually exploring coordination strategy for llm-based multi-agent collaboration. arXiv preprint arXiv:2404.11943. — [arXiv:2404.11943](https://arxiv.org/abs/2404.11943) find
  77. Lihang Pan, Yuxuan Li, Chun Yu, and Yuanchun Shi. 2024b. A human-computer collaborative tool for training a single large language model agent into a network through few examples. arXiv preprint arXiv:2404.15974. — [arXiv:2404.15974](https://arxiv.org/abs/2404.15974) find
  78. Pat Pataranutaporn, Sheer Karny, Chayapatr Archi-waranguprok, Constanze Albrecht, Auren R Liu, and Pattie Maes. 2025. " my boyfriend is ai": A computational analysis of human-ai companionship in reddit’s ai community. arXiv preprint arXiv:2509.11391. — [arXiv:2509.11391](https://arxiv.org/abs/2509.11391) find
  79. Qiyao Peng, Hongtao Liu, Hua Huang, Qing Yang, and Minglai Shao. 2025. A survey on llm-powered agents for recommender systems. arXiv preprint arXiv:2502.10050. find
  80. Cheng Qian, Zuxin Liu, Akshara Prabhakar, Zhiwei Liu, Jianguo Zhang, Haolin Chen, Heng Ji, Weiran Yao, Shelby Heinecke, Silvio Savarese, Caiming Xiong, and Huan Wang. 2025a. Userbench: An interactive gym environment for user-centric agents. ArXiv, abs/2507.22034. — [arXiv:2507.22034](https://arxiv.org/abs/2507.22034) find
  81. Cheng Qian, Zuxin Liu, Akshara Prabhakar, Jielin Qiu, Zhiwei Liu, Haolin Chen, Shirley Kokane, Heng Ji, Weiran Yao, Shelby Heinecke, Silvio Savarese, Caiming Xiong, and Huan Wang. 2025b. Userrl: Training interactive user-centric agent via reinforcement learning. ArXiv, abs/2509.19736. — [arXiv:2509.19736](https://arxiv.org/abs/2509.19736) find
  82. Jiahao Qiu, Yinghui He, Xinzhe Juan, Yiming Wang, Yuhan Liu, Zixin Yao, Yue Wu, Xun Jiang, Ling Yang, and Mengdi Wang. 2025. Emoagent: Assessing and safeguarding human-ai interaction for mental health safety. arXiv preprint arXiv:2504.09689. find
  83. David G Rand and Martin A Nowak. 2013. Human cooperation. Trends in cognitive sciences, 17(8):413– 425. find
  84. Vinay Samuel, Henry Peng Zou, Yue Zhou, Shreyas Chaudhari, Ashwin Kalyan, Tanmay Rajpurohit, Ameet Deshpande, Karthik Narasimhan, and Vishvak Murahari. 2024. Personagym: Evaluating persona agents and llms. arXiv preprint arXiv:2407.18416. find
  85. SeungWon Seo, SeongRae Noh, Junhyeok Lee, SooBin Lim, Won Hee Lee, and HyeongYeop Kang. 2025. Reveca: Adaptive planning and trajectory-based validation in cooperative language agents using information relevance and relative proximity. In Proceedings of the AAAI Conference on Artificial Intelligence,… find
  86. Kathrin Seßler, Arne Bewersdorff, Claudia Nerdel, and Enkelejda Kasneci. 2025. Towards adaptive feedback with ai: Comparing the feedback quality of llms and teachers on experimentation protocols. arXiv preprint arXiv:2502.12842. — [arXiv:2502.12842](https://arxiv.org/abs/2502.12842) find
  87. Yijia Shao, Vinay Samuel, Yucheng Jiang, John Yang, and Diyi Yang. 2024. Collaborative gym: A framework for enabling and evaluating human-agent collaboration. arXiv preprint arXiv:2412.15701. find
  88. Yijia Shao, Humishka Zope, Yucheng Jiang, Jiaxin Pei, David Nguyen, Erik Brynjolfsson, and Diyi Yang. 2025. Future of work with ai agents: Auditing automation and augmentation potential across the us workforce. arXiv preprint arXiv:2506.06576. find
  89. Ashish Sharma, Sudha Rao, Chris Brockett, Akanksha Malhotra, Nebojsa Jojic, and Bill Dolan. 2024. Investigating agency of llms in human-ai collaboration tasks. Preprint, arXiv:2305.12815. find
  90. Amanpreet Singh, Tushar Jain, and Sainbayar Sukhbaatar. 2018. Learning when to communicate at scale in multiagent cooperative and competitive tasks. arXiv preprint arXiv:1812.09755. — [arXiv:1812.09755](https://arxiv.org/abs/1812.09755) find
  91. Jonathan Spencer, Sanjiban Choudhury, Matthew Barnes, Matthew Schmittle, Mung Chiang, Peter Ramadge, and Siddhartha Srinivasa. 2020. Learning from interventions: Human-robot interaction as both explicit and implicit feedback. In 16th robotics: science and systems, RSS 2020. MIT Press Journals. find
  92. Haotian Sun, Yuchen Zhuang, Lingkai Kong, Bo Dai, and Chao Zhang. 2023. Adaplanner: Adaptive planning from feedback with language models. In Thirty-seventh Conference on Neural Information Processing Systems. find
  93. Nan Sun, Bo Mao, Yongchang Li, Lumeng Ma, Di Guo, and Huaping Liu. 2024a. Assistantx: An llm-powered proactive assistant in collaborative human-populated environment. arXiv preprint arXiv:2409.17655. — [arXiv:2409.17655](https://arxiv.org/abs/2409.17655) find
  94. Nan Sun, Chengming Shi, and Yuwen Dong. 2024b. Interactgen: Enhancing human-involved embodied task reasoning through llm-based multi-agent collaboration. In under review. find
  95. Qiang Sun, Tingting Bi, Sirui Li, Eun-Jung Holden, Paul Duuring, Kai Niu, and Wei Liu. 2025a. Sym-bioticrag: Enhancing document intelligence through human-llm symbiotic collaboration. arXiv preprint arXiv:2505.02418. — [arXiv:2505.02418](https://arxiv.org/abs/2505.02418) find
  96. Weiwei Sun, Xuhui Zhou, Weihua Du, Xingyao Wang, Sean Welleck, Graham Neubig, Maarten Sap, and Yiming Yang. 2025b. Training proactive and personalized llm agents. arXiv preprint arXiv:2511.02208. find
  97. Yi Tang, Chia-Ming Chang, and Xi Yang. 2024. Pdfchatannotator: A human-llm collaborative multimodal data annotation tool for pdf-format catalogs. In Proceedings of the 29th International Conference on Intelligent User Interfaces, IUI ’24, page 419–430, New York, NY, USA. Association for Computing Ma… find
  98. Yinghao Tang, Yupeng Xie, Yingchaojie Feng, Tingfeng Lan, Jiale Lao, Yue Cheng, and Wei Chen. 2026. Vividoc: Generating interactive documents through human-agent collaboration. arXiv preprint arXiv:2603.27991. — [arXiv:2603.27991](https://arxiv.org/abs/2603.27991) find
  99. Daniel Tanneberg, Felix Ocker, Stephan Hasler, Joerg Deigmoeller, Anna Belardinelli, Chao Wang, Heiko Wersing, Bernhard Sendhoff, and Michael Gienger. 2024. To help or not to help: Llm-based attentive support for human-robot group interactions. In 2024 IEEE/RSJ International Conference on Intelligen… find
  100. Shahroz Tariq, Mohan Baruwal Chhetri, Surya Nepal, and Cecile Paris. 2025. A2c: A modular multi-stage collaborative decision framework for human-ai teams. Expert Systems with Applications, page 127318. find
  101. Khanh-Tung Tran, Dung Dao, Minh-Duong Nguyen, Quoc-Viet Pham, Barry O’Sullivan, and Hoang D Nguyen. 2025. Multi-agent collaboration mechanisms: A survey of llms. arXiv preprint arXiv:2501.06322. find
  102. Michael T Turvey. 1990. Coordination. American psychologist, 45(8):938. find
  103. Vanshika Vats, Marzia Binta Nizam, Minghao Liu, Ziyuan Wang, Richard Ho, Mohnish Sai Prasad, Vincent Titterton, Sai Venkat Malreddy, Riya Aggarwal, Yanwen Xu, and 1 others. 2024. A survey on human-ai teaming with large pre-trained models. arXiv preprint arXiv:2403.04931. — [arXiv:2403.04931](https://arxiv.org/abs/2403.04931) find
  104. Ben Wang. 2024. Golf: Goal-oriented long-term life tasks supported by human-ai collaboration. In Proceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 3072–3072. find
  105. Dakuo Wang, Ting-Yao Hsu, Yuxuan Lu, Limeng Cui, Yaochen Xie, William Headean, Bingsheng Yao, Akash Veeragouni, Jiapeng Liu, Sreyashi Nag, and 1 others. 2025a. Agenta/b: Automated and scalable web a/btesting with interactive llm agents. arXiv preprint arXiv:2504.09723. — [arXiv:2504.09723](https://arxiv.org/abs/2504.09723) find
  106. Tongshuang Wu, Michael Terry, and Carrie Jun Cai. 2022a. Ai chains: Transparent and controllable human-ai interaction by chaining large language model prompts. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems, CHI ’22, New York, NY, USA. Association for Computing Machi… find
  107. Xingjiao Wu, Luwei Xiao, Yixuan Sun, Junhang Zhang, Tianlong Ma, and Liang He. 2022b. A survey of human-in-the-loop for machine learning. Future Generation Computer Systems, 135:364–381. find
  108. Lei Wang, Chen Ma, Xueyang Feng, Zeyu Zhang, Hao Yang, Jingsen Zhang, Zhiyuan Chen, Jiakai Tang, Xu Chen, Yankai Lin, and 1 others. 2024a. A survey on large language model based autonomous agents. Frontiers of Computer Science, 18(6):186345.
  109. Yaozu Wu, Dongyuan Li, Yankai Chen, Renhe Jiang, Henry Peng Zou, Liancheng Fang, Zhen Wang, and Philip S Yu. 2025b. Multi-agent autonomous driving systems with large language models: A survey of recent advances. arXiv preprint arXiv:2502.16804. — [arXiv:2502.16804](https://arxiv.org/abs/2502.16804) find
  110. Qian Wang, Biao Zhang, Michael Birsak, and Peter Wonka. 2023. Instructedit: Improving automatic masks for diffusion-based image editing with user instructions. arXiv preprint arXiv:2305.18047. — [arXiv:2305.18047](https://arxiv.org/abs/2305.18047) find
  111. Zhenyu Wu, Ziwei Wang, Xiuwei Xu, Jiwen Lu, and Haibin Yan. 2023. Embodied task planning with large language models. arXiv preprint arXiv:2307.01848. — [arXiv:2307.01848](https://arxiv.org/abs/2307.01848) find
  112. Wenxuan Wang, Zizhan Ma, Zheng Wang, Chenghan Wu, Wenting Chen, Xiang Li, and Yixuan Yuan. 2025b. A survey of llm-based agents in medicine: How far are we from baymax? arXiv preprint arXiv:2502.11211. find
  113. Zhiheng Xi, Wenxiang Chen, Xin Guo, Wei He, Yiwen Ding, Boyang Hong, Ming Zhang, Junzhe Wang, Senjie Jin, Enyu Zhou, and 1 others. 2025. The rise and potential of large language model based agents: A survey. Science China Information Sciences, 68(2):121101.
  114. Xingyao Wang, Zihan Wang, Jiateng Liu, Yangyi Chen, Lifan Yuan, Hao Peng, and Heng Ji. 2024b. MINT: Evaluating LLMs in multi-turn interaction with tools and language feedback. In The Twelfth International Conference on Learning Representations.
  115. Xingzhi Wang, Zhoumingju Jiang, Yi Xiong, and Ang Liu. 2025c. Human-llm collaboration in generative design for customization. Journal of Manufacturing Systems, 80:425–435. find
  116. Ziyan Wang, Meng Fang, Tristan Tomilin, Fei Fang, and Yali Du. 2024c. Safe multi-agent reinforcement learning with natural language constraints. arXiv preprint arXiv:2405.20018. — [arXiv:2405.20018](https://arxiv.org/abs/2405.20018) find
  117. Ziyan Wang, Zhicheng Zhang, Fei Fang, and Yali Du. 2025d. M3hf: Multi-agent reinforcement learning from multi-phase human feedback of mixed quality. arXiv preprint arXiv:2503.02077. — [arXiv:2503.02077](https://arxiv.org/abs/2503.02077) find
  118. Joseph Weizenbaum. 1966. Eliza—a computer program for the study of natural language communication between man and machine. Communications of the ACM, 9(1):36–45. find
  119. Hengjia Xiao and Peng Wang. 2023. Llm a*: Human in the loop large language models enabled a* search for robotics. arXiv preprint arXiv:2312.01797. — [arXiv:2312.01797](https://arxiv.org/abs/2312.01797) find
  120. Chengxing Xie, Canyu Chen, Feiran Jia, Ziyu Ye, Shiyang Lai, Kai Shu, Jindong Gu, Adel Bibi, Ziniu Hu, David Jurgens, and 1 others. 2024a. Can large language model agents simulate human trust behavior? In The Thirty-eighth Annual Conference on Neural Information Processing Systems. find
  121. Jian Xie, Kai Zhang, Jiangjie Chen, Tinghui Zhu, Renze Lou, Yuandong Tian, Yanghua Xiao, and Yu Su. 2024b. Travelplanner: A benchmark for real-world planning with language agents. In ICLR 2024 Workshop on Large Language Model (LLM) Agents. find
  122. Congluo Xu, Zhaobin Liu, and Ziyang Li. 2025. Finarena: A human-agent collaboration framework for financial market analysis and forecasting. arXiv preprint arXiv:2503.02692. — [arXiv:2503.02692](https://arxiv.org/abs/2503.02692) find
  123. Terry Winograd. 1972. Understanding natural language. Cognitive psychology, 3(1):1–191. find
  124. Hongshen Xu, Zichen Zhu, Lei Pan, Zihan Wang, Su Zhu, Da Ma, Ruisheng Cao, Lu Chen, and Kai Yu. 2024. Reducing tool hallucination via reliability alignment. arXiv preprint arXiv:2412.04141. — [arXiv:2412.04141](https://arxiv.org/abs/2412.04141) find
  125. Shirley Wu, Michel Galley, Baolin Peng, Hao Cheng, Gavin Li, Yao Dou, Weixin Cai, James Zou, Jure Leskovec, and Jianfeng Gao. 2025a. CollabLLM: From passive responders to active collaborators. In Forty-second International Conference on Machine Learning. find
  126. Wei Xu, Marvin J Dainoff, Liezhong Ge, and Zaifeng Gao. 2023. Transitioning to human interaction with ai systems: New challenges and opportunities for hci professionals to enable human-centered ai. International Journal of Human–Computer Interaction, 39(3):494–518. find
  127. Bingyu Yan, Xiaoming Zhang, Litian Zhang, Lian Zhang, Ziyi Zhou, Dezhuang Miao, and Chaozhuo Li. 2025. Beyond self-talk: A communication-centric survey of llm-based multi-agent systems. arXiv preprint arXiv:2502.14321. — [arXiv:2502.14321](https://arxiv.org/abs/2502.14321) find
  128. Lixiang Yan. 2025. From passive tool to socio-cognitive teammate: A conceptual framework for agentic ai in human-ai collaborative learning. arXiv preprint arXiv:2508.14825. — [arXiv:2508.14825](https://arxiv.org/abs/2508.14825) find
  129. Shunyu Yao, Noah Shinn, Pedram Razavi, and Karthik R Narasimhan. 2025. {$\\tau$}-bench: A benchmark for \\underline{T}ool-\\underline{A}gent-\\underline{U}ser interaction in real-world domains. In The Thirteenth International Conference on Learning Representations. find
  130. Shunyu Yao, Jeffrey Zhao, Dian Yu, Nan Du, Izhak Shafran, Karthik R Narasimhan, and Yuan Cao. 2022. React: Synergizing reasoning and acting in language models. In The eleventh international conference on learning representations.
  131. Yang Ye, Hengxu You, and Jing Du. 2023. Improved trust in human-robot collaboration with chatgpt. IEEE Access, 11:55748–55754. find
  132. Asaf Yehudai, Lilach Eden, Alan Li, Guy Uziel, Yilun Zhao, Roy Bar-Haim, Arman Cohan, and Michal Shmueli-Scheuer. 2025. Survey on evaluation of llm-based agents. arXiv preprint arXiv:2503.16416. — [arXiv:2503.16416](https://arxiv.org/abs/2503.16416) find
  133. Steve Young, Milica Gašić, Blaise Thomson, and Jason D Williams. 2013. Pomdp-based statistical spoken dialog systems: A review. Proceedings of the IEEE, 101(5):1160–1179. find
  134. Yifu Yuan, Jianye HAO, Yi Ma, Zibin Dong, Hebin Liang, Jinyi Liu, Zhixin Feng, Kai Zhao, and YAN ZHENG. 2024. Uni-RLHF: Universal platform and benchmark suite for reinforcement learning with diverse human feedback. In The Twelfth International Conference on Learning Representations. find
  135. Hanrong Zhang, Shicheng Fan, Henry Peng Zou, Yankai Chen, Zhenting Wang, Jiayu Zhou, Chengze Li, Wei-Chieh Huang, Yifei Yao, Kening Zheng, and 1 others. 2026. Evoskills: Self-evolving agent skills via co-evolutionary verification. arXiv preprint arXiv:2604.01687. — [arXiv:2604.01687](https://arxiv.org/abs/2604.01687) find
  136. Shao Zhang, Xihuai Wang, Wenhao Zhang, Chaoran Li, Junru Song, Tingyu Li, Lin Qiu, Xuezhi Cao, Xunliang Cai, Wen Yao, and 1 others. 2025. Leveraging dual process theory in language agent framework for real-time simultaneous human-ai collaboration. arXiv preprint arXiv:2502.11882. find
  137. Xuan Zhang, Yang Deng, Zifeng Ren, See-Kiong Ng, and Tat-Seng Chua. 2024c. Ask-before-plan: Proactive language agents for real-world planning. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 10836–10863, Miami, Florida, USA. Association for Computational Linguistics. find
  138. Weikang Zhao, Xili Wang, Chengdi Ma, Lingbin Kong, Zhaohua Yang, Mingxiang Tuo, Xiaowei Shi, Yitao Zhai, and Xunliang Cai. 2025. Mua-rl: Multi-turn user-interacting agent reinforcement learning for agentic tool use. ArXiv, abs/2508.18669. — [arXiv:2508.18669](https://arxiv.org/abs/2508.18669) find
  139. Xuhui Zhou, Hao Zhu, Leena Mathur, Ruohong Zhang, Haofei Yu, Zhengyang Qi, Louis-Philippe Morency, Yonatan Bisk, Daniel Fried, Graham Neubig, and Maarten Sap. 2024. SOTOPIA: Interactive evaluation for social intelligence in language agents. In The Twelfth International Conference on Learning Represe…
  140. Yifei Zhou, Song Jiang, Yuandong Tian, Jason Weston, Sergey Levine, Sainbayar Sukhbaatar, and Xian Li. 2025. Sweet-rl: Training multi-turn llm agents on collaborative reasoning tasks. Preprint, arXiv:2503.15478. — [arXiv:2503.15478](https://arxiv.org/abs/2503.15478) find
  141. Henry Peng Zou, Wei-Chieh Huang, Yaozu Wu, Chunyu Miao, Dongyuan Li, Aiwei Liu, Yue Zhou, Yankai Chen, Weizhi Zhang, Yangning Li, and 1 others. 2025. A call for collaborative intelligence: Why human-agent systems should precede ai autonomy. arXiv preprint arXiv:2506.09420. — [arXiv:2506.09420](https://arxiv.org/abs/2506.09420) find
  142. Henry Peng Zou, Chunyu Miao, Wei-Chieh Huang, Yankai Chen, Yue Zhou, Hanrong Zhang, Yaozu Wu, Liancheng Fang, Zhengyao Gu, Zhen Zhang, and 1 others. 2026. When users change their mind: Evaluating interruptible agents in long-horizon web navigation. arXiv preprint arXiv:2604.00892. — [arXiv:2604.00892](https://arxiv.org/abs/2604.00892) find
  143. Hongxin Zhang, Weihua Du, Jiaming Shan, Qinhong Zhou, Yilun Du, Joshua B. Tenenbaum, Tianmin Shu, and Chuang Gan. 2024a. Building cooperative embodied agents modularly with large language models. In The Twelfth International Conference on Learning Representations. find
  144. Shao Zhang, Xihuai Wang, Wenhao Zhang, Yongshan Chen, Landi Gao, Dakuo Wang, Weinan Zhang, Xinbing Wang, and Ying Wen. 2024b. Mutual theory of mind in human-ai collaboration: An empirical study with llm-driven ai agents in a real-time shared workspace task. ArXiv, abs/2409.08811. — [arXiv:2409.08811](https://arxiv.org/abs/2409.08811) find

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/zou-2026-llm-based-human-agent-collaboration/