R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning
Paper · 2026 · Minggui He, Yilun Liu, Shimin Tao et al.
Summary
Reasoning-oriented LLMs that think step by step before answering have mostly been applied to math and code. Machine translation has received less attention, even though professional translators reason in layers. Earlier reasoning-based MT work either used one fixed thinking procedure (e.g., TASTE) or LLM-distilled chains of thought (e.g., DRT, aimed at Chinese-English literary translation), trained only with SFT. That setup tends to overfit and generalizes poorly. R1-Translator (R1-T1) addresses this in two stages:
- Cold start with SFT. Working with professional translators, the authors defined six CoT templates that reflect common translator strategies, such as context-aware paraphrasing and round-trip translation. They then fine-tuned the model on a mix of these reasoning trajectories.
- RL with MT-specific rewards. This stage lets the model adapt the learned strategies flexibly rather than reciting them.
Both human and automatic evaluation show consistent quality gains across 10+ languages and 40+ directions on Flores-101 and four domain-specific tasks. The gains are largest for languages unseen in training. This suggests that human-aligned reasoning plus RL is a general way to improve LLM translation, not one limited to a single domain.
Key points
- R1-T1 relies on six expert-curated CoT templates covering hybrid translator strategies, including round-trip translation and context-aware paraphrasing.
- Training has two stages: SFT on hybrid CoT trajectories as a cold start, then RL refinement with MT-tailored rewards. One shown configuration uses Qwen2.5-7B-Instruct as the base model.
- Evaluation covers Flores-101 (10+ languages, 40+ directions, including low-resource ones) and four domain MT tasks, such as culture, common sense and terminology-constrained translation.
- In ablation case studies, SFT-only reproduces strategies as a rigid narrative, while RL-only yields shallow reasoning and omissions. The combined model grounds its reasoning decisions in the final output.
- Baselines in the case studies include DeepSeek-R1-Distill-Qwen-7B and Marco-o1. R1-T1 avoids their verbose, unresolved reasoning and the omissions in their outputs.
Institutions
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 18,614 worksArtificial Intelligence · 17,965 worksArts and Humanities · 17,450 worksLanguage and Linguistics · 17,296 works
🧭 Topics 1Research subjects and languages the work is about.Reasoning · 1,685 works
Cite
Cite as Minggui He, Yilun Liu, Shimin Tao, Hongyong Zeng, Jian Zhang, Yuanchang Luo, Li Zhang, Daimeng Wei, Weibin Meng and Osamu Yoshie. 2026. R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning. Transactions of the Association for Computational Linguistics.
@article{he2026r1,
title = {{R1-T1: Fully Incentivizing Translation Capability in LLMs via Reasoning Learning}},
author = {Minggui He, Yilun Liu, Shimin Tao, Hongyong Zeng, Jian Zhang, Yuanchang Luo, Li Zhang, Daimeng Wei, Weibin Meng and Osamu Yoshie},
journal = {Transactions of the Association for Computational Linguistics},
year = {2026},
doi = {10.1162/tacl.a.793},
url = {https://doi.org/10.1162/tacl.a.793}
}References
- Sweta Agrawal, António Farinhas, Ricardo Rei, and André F. T. Martins. 2024. Can automatic metrics assess high-quality translations? In Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing, pages 14438–14457. Association for Computational Linguistics. find
- Ali Almanna. 2015. Contextualizing translation theories: Aspects of Arabic–English interlingual communication. Cambridge Scholars Publishing. find
- Marta Bañón, Pinzhen Chen, Barry Haddow, Kenneth Heafield, Hieu Hoang, Miquel Esplà-Gomis, Mikel Forcada, Amir Kamran, Faheem Kirefu, Philipp Koehn, et al. 2020. Paracrawl: Web-scale acquisition of parallel corpora. In Proceedings of the 58th Annual Meeting of the Association for Computational Lingu…
- Loïc Barrault, Ondřej Bojar, Marta R. Costa-jussà, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, Shervin Malmasi, Christof Monz, Mathias Müller, Santanu Pal, Matt Post, and Marcos Zampieri. 2019. Findings of the 2019 conference on machine translation (…
- Ondřej Bojar, Christian Federmann, Mark Fishel, Yvette Graham, Barry Haddow, Matthias Huck, Philipp Koehn, and Christof Monz. 2018. Findings of the 2018 conference on machine translation (WMT18). In Proceedings of the Third Conference on Machine Translation: Shared Task Papers, pages 272–303, Belgi…
- Sabri Boughorbel, Md Rizwan Parvez, and Majd Hawasly. 2024. Improving language models trained on translated data with continual pre-training and dictionary learning analysis. In Proceedings of the Second Arabic Natural Language Processing Conference, pages 73–88, Bangkok, Thailand. Association for C…
- Axel Bühler. 2002. Translation as interpretation. Translation studies: Perspectives on an emerging discipline, pages 56–74. find
- Melania Cabezas-García. 2023. The use of context in multiword-term translation. Perspectives, 31(2):365–382. find
- Tianzhe Chu, Yuexiang Zhai, Jihan Yang, Shengbang Tong, Saining Xie, Dale Schuurmans, Quoc V Le, Sergey Levine, and Yi Ma. 2025a. SFT memorizes, RL generalizes: A comparative study of foundation model post-training. In International Conference on Machine Learning, pages 10818–10838. PMLR.
- Xu Chu, Zhijie Tan, Hanlin Xue, Guanyu Wang, Tong Mo, and Weiping Li. 2025b. Domaino1s: Guiding LLM reasoning for explainable answers in high-stakes domains. In Findings of the Association for Computational Linguistics: ACL 2025, pages 3330–3348. Association for Computational Linguistics. find
- DeepSeek-AI. 2025. DeepSeek-R1: Incentivizing reasoning capability in LLMs via reinforcement learning. arXiv preprint arXiv:2501.12948v1. Version referenced: v1.
- Zhaopeng Feng, Yan Zhang, Hao Li, Bei Wu, Jiayu Liao, Wenqiang Liu, Jun Lang, Yang Feng, Jian Wu, and Zuozhu Liu. 2025. TEaR: Improving LLM-based machine translation with systematic self-refinement. In Findings of the Association for Computational Linguistics: NAACL 2025, pages 3922–3938, Albuquerqu… find
- Markus Freitag, George Foster, David Grangier, Viresh Ratnakar, Qijun Tan, and Wolfgang Macherey. 2021. Experts, errors, and context: A large-scale study of human evaluation for machine translation. Transactions of the Association for Computational Linguistics, 9:1460– 1474.
- Atsushi Fujii, Masao Utiyama, and Eiichiro Sumita. 2020. Continual learning for neural machine translation. In Proceedings of the 28th International Conference on Computational Linguistics. find
- Naman Goyal, Cynthia Gao, Vishrav Chaudhary, Peng-Jen Chen, Guillaume Wenzek, Da Ju, Sanjana Krishnan, Marc’Aurelio Ranzato, Francisco Guzmán, and Angela Fan. 2022. The FLORES-101 evaluation benchmark for low-resource and multilingual machine translation. Transactions of the Association for Computat… find
- Nuno M. Guerreiro, Ricardo Rei, Daan van Stigt, Luisa Coheur, Pierre Colombo, and André F. T. Martins. 2024. xCOMET: Transparent machine translation evaluation through fine-grained error detection. Transactions of the Association for Computational Linguistics, 12:979–995.
- Jie He, Tao Wang, Deyi Xiong, and Qun Liu. 2020. The box is in the pen: Evaluating commonsense reasoning in neural machine translation. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 3662–3672, Online. Association for Computational Linguistics. find
- Aaron Hurst, Adam Lerer, Adam P. Goucher, Adam Perelman, Aditya Ramesh, Aidan Clark, AJ Ostrow, Akila Welihinda, Alan Hayes, Alec Radford, et al. 2024. GPT-4o system card. arXiv preprint arXiv:2410.21276v1. Version referenced: v1.
- Aaron Jaech, Adam Kalai, Adam Lerer, Adam Richardson, Ahmed El-Kishky, Aiden Low, Alec Helyar, Aleksander Madry, Alex Beutel, Alex Carney, et al. 2024. OpenAI o1 system card. arXiv preprint arXiv:2412.16720v1. Version referenced: v1.
- Hui Jiao, Bei Peng, Lu Zong, Xiaojun Zhang, and Xinwei Li. 2024. Gradable chatgpt translation evaluation. Procesamiento del Lenguaje Natural, 72:73–85. find
- Wenxiang Jiao, Jen-tse Huang, Wenxuan Wang, Zhiwei He, Tian Liang, Xing Wang, Shuming Shi, and Zhaopeng Tu. 2023a. Parrot: Translating during chat using large language models tuned with human translation and feedback. In Findings of the Association for Computational Linguistics: EMNLP 2023. Associat… find
- Wenxiang Jiao, Wenxuan Wang, Jen-tse Huang, Xing Wang, Shuming Shi, and Zhaopeng Tu. 2023b. Is ChatGPT a good translator? yes with GPT-4 as the engine. arXiv preprint arXiv:2301.08745v4. Version referenced: v4.
- Juraj Juraska, Mara Finkelstein, Daniel Deutsch, Aditya Siddhant, Mehdi Mirzazadeh, and Markus Freitag. 2023. MetricX-23: The google submission to the WMT 2023 metrics shared task. In Proceedings of the Eighth Conference on Machine Translation, pages 756–767. Association for Computational Linguistic…
- Hyunwoo Ko, Guijin Son, and Dasol Choi. 2025. Understand, solve and translate: Bridging the multilingual mathematical reasoning gap. In Proceedings of the 5th Workshop on Multilingual Representation Learning (MRL 2025), pages 78– 95, Suzhuo, China. Association for Computational Linguistics. find
- Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondřej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, et al. 2024a. Findings of the WMT24 general machine translation shared task: The LLM era is here but MT is not solved yet. In Proceedi…
- Tom Kocmi, Eleftherios Avramidis, Rachel Bawden, Ondrej Bojar, Anton Dvorkovich, Christian Federmann, Mark Fishel, Markus Freitag, Thamme Gowda, Roman Grundkiewicz, et al. 2024b. Preliminary WMT24 ranking of general MT systems and LLMs. arXiv preprint arXiv:2407.19884v1. Version referenced: v1. — [arXiv:2407.19884](https://arxiv.org/abs/2407.19884) find
- Eugene Albert Nida. 1964. Toward a science of translating: with special reference to principles and procedures involved in Bible translating. Brill Archive. find
- NLLB Team, Marta R. Costa-jussà, James Cross, Onur Çelebi, Maha Elbayad, Kenneth Heafield, Kevin Heffernan, Elahe Kalbassi, Janice Lam, Daniel Licht, Jean Maillard, et al. 2022. No language left behind: Scaling human-centered machine translation. arXiv preprint arXiv:2207.04672v3. Version referenced… find
- Mahmoud Ordudari. 2007. Translation procedures, strategies and methods. Translation journal, 11(3):8. find
- Long Ouyang, Jeffrey Wu, Xu Jiang, Diogo Almeida, Carroll Wainwright, Pamela Mishkin, Chong Zhang, Sandhini Agarwal, Katarina Slama, Alex Ray, et al. 2022. Training language models to follow instructions with human feedback. Advances in Neural Information Processing Systems, 35:27730–27744.
- Keqin Peng, Liang Ding, Qihuang Zhong, Li Shen, Xuebo Liu, Min Zhang, Yuanxin Ouyang, and Dacheng Tao. 2023. Towards making the most of ChatGPT for machine translation. In Findings of the Association for Computational Linguistics: EMNLP 2023, pages 5622–5633, Singapore. Association for Computational…
- Yiwei Qin, Xuefeng Li, Haoyang Zou, Yixiu Liu, Shijie Xia, Zhen Huang, Yixin Ye, Weizhe Yuan, Hector Liu, Yuanzhi Li, and Pengfei Liu. 2024. o1 replication journey: A strategic progress report–part 1. arXiv preprint arXiv:2410.18982v1. Version referenced: v1.
- Ricardo Rei, José G. C. De Souza, Duarte Alves, Chrysoula Zerva, Ana C. Farinha, Taisiya Ricardo Rei, Craig Stewart, Ana C Farinha, and Alon Lavie. 2020. COMET: A neural framework for MT evaluation. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), pa…
- Martin Ringmar. 2012. Relay translation. Handbook of translation studies, 3:141–144. find
- John Schulman, Filip Wolski, Prafulla Dhariwal, Alec Radford, and Oleg Klimov. 2017. Proximal policy optimization algorithms. arXiv preprint arXiv:1707.06347v2. Version referenced: v2. find
- Lisa Schut, Yarin Gal, and Sebastian Farquhar. 2025. Do multilingual LLMs think in english? In ICLR 2025 Workshop on Building Trust in Language Models and Applications. find
- Zhihong Shao, Peiyi Wang, Qihao Zhu, Runxin Xu, Junxiao Song, Xiao Bi, Haowei Zhang, Mingchuan Zhang, Y.K. Li, Y. Wu, and Daya Guo. 2024. DeepSeekMath: Pushing the limits of mathematical reasoning in open language models. arXiv preprint arXiv:2402.03300v3. Version referenced: v3.
- Haozhan Shen, Peng Liu, Jingcheng Li, Chunxin Fang, Yibo Ma, Jiajia Liao, Qiaoli Shen, Zilun Zhang, Kangjia Zhao, Qianqian Zhang, Ruochen Xu, and Tiancheng Zhao. 2025. VLM-R1: A stable and generalizable R1-style large vision-language model. arXiv preprint arXiv:2504.07615v2. Version referenced: v2.
- Harold Somers. 2005. Round-trip translation: What is it good for? In Proceedings of the Australasian Language Technology Workshop 2005, pages 127–133, Sydney, Australia. find
- Muhammad Naeem Ul Hassan, Zhengtao Yu, Jian Wang, Ying Li, Shengxiang Gao, Shuwan Yang, and Cunli Mao. 2024. Lkmt: Linguistics knowledge-driven multi-task neural machine translation for urdu and english. Computers, Materials & Continua, 81(1). find
- Jiaan Wang, Fandong Meng, Yunlong Liang, and Jie Zhou. 2025a. DRT: Deep reasoning translation via long chain-of-thought. In Findings of the Association for Computational Linguistics: ACL 2025, pages 6770–6782. Association for Computational Linguistics. find
- Jiaan Wang, Fandong Meng, Yingxue Zhang, and Jie Zhou. 2025b. Retrieval-augmented machine translation with unstructured knowledge. In Findings of the Association for Computational Linguistics: EMNLP 2025, pages 5858–5871. Association for Computational Linguistics. find
- Yutong Wang, Jiali Zeng, Xuebo Liu, Fandong Meng, Jie Zhou, and Min Zhang. 2024. TasTe: Teaching large language models to translate through self-reflection. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 6144–6158, Bangkok, T… find
- Jason Wei, Xuezhi Wang, Dale Schuurmans, Maarten Bosma, Brian Ichter, Fei Xia, Ed H. Chi, Quoc V. Le, and Denny Zhou. 2022. Chain-of-thought prompting elicits reasoning in large language models. Advances in Neural Information Processing Systems, 35:24824–24837.
- Minghao Wu, Thuy-Trang Vu, Lizhen Qu, George Foster, and Gholamreza Haffari. 2024. Adapting large language models for document-level machine translation. arXiv preprint arXiv:2401.06468v4. Version referenced: v4. — [arXiv:2401.06468](https://arxiv.org/abs/2401.06468) find
- Haoran Xu, Young Jin Kim, Amr Sharaf, and Hany Hassan Awadalla. 2024. A paradigm shift in machine translation: Boosting translation performance of large language models. In The Twelfth International Conference on Learning Representations. find
- Haoran Xu, Kenton Murray, Philipp Koehn, Hieu Hoang, Akiko Eriguchi, and Huda Khayrallah. 2025. X-ALMA: Plug & play modules and adaptive rejection for quality translation at scale. In Proceedings of the Thirteenth International Conference on Learning Representations. find
- An Yang, Baosong Yang, Beichen Zhang, Binyuan Hui, Bo Zheng, Bowen Yu, Chengyuan Li, Dayiheng Liu, Fei Huang, Guanting Dong, et al. 2024. Qwen2.5 technical report. arXiv preprint arXiv:2412.15115v2. Version referenced: v2. find
- Binwei Yao, Ming Jiang, Tara Bobinac, Diyi Yang, and Junjie Hu. 2024. Benchmarking machine translation with cultural awareness. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 13078–13096.
- Huaao Zhang, Qiang Wang, Bo Qin, Zelin Shi, Haibo Wang, and Ming Chen. 2023a. Understanding and improving the robustness of terminology constraints in neural machine translation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages… find
- Xuan Zhang, Navid Rajabi, Kevin Duh, and Philipp Koehn. 2023b. Machine translation with large language models: Prompting, few-shot learning, and fine-tuning with QLoRA. In Proceedings of the Eighth Conference on Machine Translation, pages 468–481. Association for Computational Linguistics. find
- Yuxiang Zhang, Shangxi Wu, Yuqi Yang, Jiangming Shu, Jinlin Xiao, Chao Kong, and Jitao Sang. 2024a. o1-Coder: an o1 replication for coding. arXiv preprint arXiv:2412.00154v2. Version referenced: v2. — [arXiv:2412.00154](https://arxiv.org/abs/2412.00154) find
- Zhihan Zhang, Dong-Ho Lee, Yuwei Fang, Wenhao Yu, Mengzhao Jia, Meng Jiang, and Francesco Barbieri. 2024b. PLUG: Leveraging pivot language in cross-lingual instruction tuning. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 70…
- Yu Zhao, Huifeng Yin, Bo Zeng, Hao Wang, Tianqi Shi, Chenyang Lyu, Longyue Wang, Weihua Luo, and Kaifu Zhang. 2024. Marco-o1: Towards open reasoning models for open-ended solutions. arXiv preprint arXiv:2411.14405v2. Version referenced: v2.
- Shaolin Zhu, Leiyu Pan, Dong Jian, and Deyi Xiong. 2025. Overcoming language barriers via machine translation with sparse mixture-of-experts fusion of large language models. Information Processing & Management, 62(3):104078. find
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/papers/he-2026-r1-t1-fully-incentivizing-translation/