ICDAGENT: Empowering Agentic Large Language Models for Explainable Medical Coding
Paper · 2026 · Ziyi Yin, Yuanpu Cao, Ting Wang et al.
Summary
The paper addresses explainable ICD coding: assigning International Classification of Diseases codes to clinical notes and justifying each code in free text. The authors argue that general-purpose commercial LLMs perform poorly here because they lack coding expertise and must navigate a huge label space of closely related codes. They propose ICDAGENT, which pairs two fine-tuned open models. A coding agent proposes codes with draft justifications. A critical agent reasons step by step to accept or reject each draft. To train the coding agent, the authors automatically built a rationale dataset from MIMIC-IV notes and official code descriptions. The critical agent first learns chain-of-thought from a proprietary teacher, then undergoes reinforcement learning with a reward that accounts for rationale quality. The two agents interact over several rounds. Across three datasets covering ICD-9 and ICD-10, ICDAGENT beats commercial LLMs and runs locally on two A100 GPUs. Local deployment lowers cost and avoids privacy risks.
Key points
- Coding agent: HuatuoGPT-o1-8B is LoRA-fine-tuned on the new D_code dataset. The dataset was built from MIMIC-IV in two automated steps: an open-source LLM extracts a rationale for each gold code, then labels are aggregated.
- Critical agent: Qwen3-4B is LoRA-tuned on CoT trajectories distilled from Gemini. It is then optimized via RL with a rationale-aware reward. Rationales for incorrect codes are regenerated.
- Baselines: The commercial LLMs compared include GPT-4o, GPT-5-Chat, Claude-3.7/4-Sonnet, and Gemini-2.5-Pro/Flash. Evaluation uses MIMIC-III and MIMIC-IV, with predicted codes extracted by string matching on delimited tokens such as |E11.9|.
- Comparison with CoRelation: On micro-level metrics, where frequent codes carry most of the weight, ICDAGENT falls behind the classifier CoRelation. It outperforms CoRelation on macro-level metrics, indicating better handling of rare, long-tail codes.
- Stated limitations: Recall still lags behind state-of-the-art classifiers. Training also requires costly annotation, including commercial API use. The authors suggest future work on enriched code guidelines combined with RAG.
Institutions
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Computer Science · 18,614 worksArtificial Intelligence · 17,965 worksBiochemistry, Genetics and Molecular Biology · 263 worksMolecular Biology · 260 worksHealth Professions · 75 worksHealth Information Management · 56 works
Cite
Cite as Ziyi Yin, Yuanpu Cao, Ting Wang, Jinghui Chen and Fenglong Ma. 2026. ICDAGENT: Empowering Agentic Large Language Models for Explainable Medical Coding. Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers).
@inproceedings{yin2026icdagent,
title = {{ICDAGENT: Empowering Agentic Large Language Models for Explainable Medical Coding}},
author = {Ziyi Yin, Yuanpu Cao, Ting Wang, Jinghui Chen and Fenglong Ma},
booktitle = {Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)},
year = {2026},
doi = {10.18653/v1/2026.acl-long.643},
url = {https://doi.org/10.18653/v1/2026.acl-long.643}
}References
- Anthropic. 2025. Introducing claude 4. https://www.anthropic.com/news/claude-4. Accessed: April 18, 2026. ↗
- Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao, Shengping Liu, and Weifeng Chong. 2020. Hypercore: Hyperbolic and co-graph representation for automatic ICD coding. In ACL, pages 3105–3114. Association for Computational Linguistics. find
- Junying Chen, Zhenyang Cai, Ke Ji, Xidong Wang, Wanlong Liu, Rongsheng Wang, Jianye Hou, and Benyou Wang. 2024. Huatuogpt-o1, towards medical complex reasoning with llms. CoRR, abs/2412.18925.
- Hua Cheng, Rana Jafari, April Russell, Russell Klopfer, Edmond Lu, Benjamin Striner, and Matthew Gormley. 2023. MDACE: MIMIC documents annotated with code evidence. In ACL (1), pages 7534–7550. Association for Computational Linguistics. find
- Gheorghe Comanici, Eric Bieber, Mike Schaekermann, Ice Pasupat, Noveen Sachdeva, Inderjit Dhillon, Marcel Blistein, Ori Ram, Dan Zhang, Evan Rosen, et al. 2025. Gemini 2.5: Pushing the frontier with advanced reasoning, multimodality, long context, and next generation agentic capabilities. arXiv prep…
- DeepSeek-AI, Daya Guo, Dejian Yang, Haowei Zhang, Junxiao Song, Ruoyu Zhang, Runxin Xu, Qihao Zhu, Shirong Ma, Peiyi Wang, Xiao Bi, Xiaokang Zhang, Xingkai Yu, Yu Wu, Z. F. Wu, Zhibin Gou, Zhihong Shao, Zhuoshu Li, Ziyi Gao, Aixin Liu, Bing Xue, Bingxuan Wang, Bochao Wu, Bei Feng, Chengda Lu, Chengg… — DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning
- James C. Douglas, Yidong Gan, Ben Hachey, and Jonathan K. Kummerfeld. 2025. Less is more: Explainable and efficient ICD code prediction with clinical entities. In ACL (1), pages 30835–30847. Association for Computational Linguistics. find
- Joakim Edin, Maria Maistro, Lars Maaløe, Lasse Borgholt, Jakob D. Havtorn, and Tuukka Ruotsalo. 2024. An unsupervised approach to achieve supervised-level explainability in healthcare records. In EMNLP, pages 4869–4890. Association for Computational Linguistics. find
- Matús Falis, Aryo Pradipta Gema, Hang Dong, Luke Daines, Siddharth Basetti, Michael Holder, Rose S. Penfold, Alexandra Birch, and Beatrice Alex. 2024. Can GPT-3.5 generate and code discharge summaries? J. Am. Medical Informatics Assoc., 31(10):2284–2293. find
- Edward J Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, and Weizhu Chen. 2021. Lora: Low-rank adaptation of large language models. arXiv preprint arXiv:2106.09685.
- Chao-Wei Huang, Shang-Chi Tsai, and Yun-Nung Chen. 2022. PLM-ICD: automatic ICD coding with pre-trained language models. CoRR, abs/2207.05289. — [arXiv:2207.05289](https://arxiv.org/abs/2207.05289) find
- Fei Li and Hong Yu. 2020. ICD coding from clinical text using multi-filter residual convolutional neural network. In AAAI, pages 8180–8187. AAAI Press. find
- Rumeng Li, Xun Wang, and Hong Yu. 2024. Exploring LLM multi-agents for ICD coding. CoRR, abs/2406.15363. — [arXiv:2406.15363](https://arxiv.org/abs/2406.15363) find
- Leibo Liu, Óscar Pérez Concha, Anthony N. Nguyen, Vicki Bennett, and Louisa Jorm. 2022. Hierarchical label-wise attention transformer model for explainable ICD coding. J. Biomed. Informatics, 133:104161. find
- Junyu Luo, Xiaochen Wang, Jiaqi Wang, Aofei Chang, Yaqing Wang, and Fenglong Ma. 2024. Corelation: Boosting automatic ICD coding through contextualized code relation learning. In LREC/COLING, pages 3997–4007. ELRA and ICCL. find
- George Michalopoulos, Michal Malyska, Nicola Sahar, Alexander Wong, and Helen H. Chen. 2022. Icdbig-bird: A contextual embedding model for ICD code classification. In BioNLP@ACL, pages 330–336. Association for Computational Linguistics. find
- Andreas Motzfeldt, Joakim Edin, Casper L Christensen, Christian Hardmeier, Lars Maaløe, and Anna Rogers. 2025. Code like humans: A multi-agent solution for medical coding. arXiv preprint arXiv:2509.05378. find
- James Mullenbach, Sarah Wiegreffe, Jon Duke, Jimeng Sun, and Jacob Eisenstein. 2018. Explainable prediction of medical codes from clinical text. In NAACL-HLT, pages 1101–1111. Association for Computational Linguistics.
- Thanh-Tung Nguyen, Viktor Schlegel, Abhinav Ramesh Kashyap, and Stefan Winkler. 2023a. A two-stage decoder for efficient ICD coding. In ACL (Findings), pages 4658–4665. Association for Computational Linguistics. find
- John Schulman, Philipp Moritz, Sergey Levine, Michael I. Jordan, and Pieter Abbeel. 2016. High-dimensional continuous control using generalized advantage estimation. In ICLR (Poster). find
- John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. CoRR, abs/1707.06347. find
- Guangming Sheng, Chi Zhang, Zilingfeng Ye, Xibin Wu, Wang Zhang, Ru Zhang, Yanghua Peng, Haibin Lin, and Chuan Wu. 2025. Hybridflow: A flexible and efficient rlhf framework. In Proceedings of the Twentieth European Conference on Computer Systems, pages 1279–1297.
- Thanh Vu, Dat Quoc Nguyen, and Anthony N. Nguyen. 2020. A label attention model for ICD coding from clinical text. In IJCAI, pages 3335–3341. ijcai.org. find
- An Yang, Anfeng Li, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chang Gao, Chengen Huang, Chenxu Lv, Chujie Zheng, Dayiheng Liu, Fan Zhou, Fei Huang, Feng Hu, Hao Ge, Haoran Wei, Huan Lin, Jialong Tang, Jian Yang, Jianhong Tu, Jianwei Zhang, Jian Yang, Jiaxi Yang, Jingren Zhou, Jun… — Qwen3 Technical Report
- Zheng Yuan, Chuanqi Tan, and Songfang Huang. 2022. Code synonyms do matter: Multiple synonyms matching network for automatic ICD coding. In ACL (2), pages 808–814. Association for Computational Linguistics. find
- Tong Zhou, Pengfei Cao, Yubo Chen, Kang Liu, Jun Zhao, Kun Niu, Weifeng Chong, and Shengping Liu. 2021. Automatic ICD coding via interactive shared representation networks with self-distillation mechanism. In ACL/IJCNLP (1), pages 5948–5957. Association for Computational Linguistics. find
- Thanh-Tung Nguyen, Viktor Schlegel, Abhinav Ramesh Kashyap, Stefan Winkler, Shao-Syuan Huang, Jie-Jyun Liu, and Chih-Jen Lin. 2023b. Mimic-iv-icd: A new benchmark for extreme multilabel classification. CoRR, abs/2304.13998. — [arXiv:2304.13998](https://arxiv.org/abs/2304.13998) find
- OpenAI. 2025. Gpt-5 system card. https://cdn.openai.com/gpt-5-system-card.pdf. Technical report describing GPT-5 safety evaluations and capabilities. Accessed: April 18, 2026. ↗
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/yin-2026-icdagent-empowering-agentic-large-language/