Tong Xiao
Tong Xiao has 9 papers in our library, in 2019–2026, most of them on Language models & pretraining, Multilingual & cross-lingual NLP, Machine translation; often with Jingbo Zhu, Bei Li, Chenglong Wang.
OpenAlex · ORCID · Wikidata · h-index 25 · 170 works · 2,223 citations OpenAlex, 2026-10-14
📄 9 works in our library · 🔗 Cited 385 times in our library · 9 more in our library without a page yet · ⭐ Paper Stars ranking: #2766
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 9 worksComputer Science · 9 worksArtificial Intelligence · 9 worksLanguage and Linguistics · 9 worksComputer Vision and Pattern Recognition · 2 worksInformation Systems · 2 worksSafety Research · 1 workSocial Sciences · 1 work
🧭 Topics 7Research subjects and languages the work is about.Machine translation · 2 worksLanguage models & pretraining · 3 worksMultilingual & cross-lingual NLP · 3 worksReasoning · 1 workDialogue systems · 1 workEvaluation & benchmarks · 1 workInformation retrieval & search · 1 work
Works by year
2020s
2010s
Papers
- Learning Deep Transformer Models for Machine Translation (2019 · 810 citations)
For Transformer-based neural machine translation, the usual way to gain quality has been to make the model wider (Transformer-Big). Simply adding encoder layers tended to make training unstable or fail outright. The authors show that depth can beat width if two problems are handled. - SLAM: Towards Efficient Multilingual Reasoning via Selective Language Alignment (2025 · 20 citations)
Large language models reason well in English but much less reliably in other languages, especially low-resource ones. - Lost in Literalism: How Supervised Training Shapes Translationese in LLMs (2025 · 12 citations)
LLMs learn from huge amounts of native text, yet their translations often still sound overly literal. The authors examine this "translationese" in LLM-based machine translation and trace it to supervised fine-tuning (SFT). Professional translators marked literal or unnatural spans in English-Chinese and… - Cross-layer Attention Sharing for Pre-trained Large Language Models (2026 · 2 citations)
Earlier work on making LLM attention more efficient mostly targets redundancy inside a layer, for example by compressing the KV cache or grouping heads. - BIASEDTALES-ML: A Multilingual Dataset for Analyzing Narrative Attribute Distributions in LLM-Generated Stories (2026)
Most studies of social bias in LLMs are English-only and rely on short-form probes. It is therefore unclear whether the attribute patterns seen in English long-form generation carry over to other languages. To test this, the authors built BIASEDTALES-ML, a parallel collection of about 350k children's stories. Three… - MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval Benchmarks (2026)
Conversational retrieval decides which evidence a RAG system can use, but its benchmarks have two kinds of flaws. - NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMs (2026)
The paper addresses how to adapt LLMs for translation across many languages without quality collapsing in some directions. - RouteLMT: Learned Sample Routing for Hybrid LLM Translation Deployment (2026)
Serving every translation request with a large LLM is too costly for industrial systems. Hybrid setups therefore send most traffic to a small model and escalate only some inputs to a large one. The authors treat this escalation decision as spending a fixed budget of large-model calls. They argue that requests should… - SERM: Self-Evolving Relevance Model with Agent-Driven Learning from Massive Query Streams (2026)
Search relevance models trained on fixed datasets lose accuracy as live query traffic changes, for example when users adopt new slang or cultural references.
All works
- Learning Deep Transformer Models for Machine TranslationAnnual Meeting of the Association for Computational Linguistics (ACL)Qiang Wang, Bei Li, Tong Xiao, et al.2019 · 810 citations
- Stacked Acoustic-and-Textual Encoding: Integrating the Pre-trained Models into Speech Translation Encoders ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetChen Xu et al.2021 · 113 citations
- Improved Differentiable Architecture Search for Language Modeling and Named Entity Recognition ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetYufan Jiang et al.2019 · 112 citations
- Does Multi-Encoder Help? A Case Study on Context-Aware Neural Machine Translation ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetBei Li et al.2020 · 111 citations
- NiuTrans: An Open Source Toolkit for Phrase-based and Syntax-based Machine Translation ↗Proceedings of the ACL 2012 System Demonstrations · no summary yetTong Xiao et al.2012 · 101 citations
- SLAM: Towards Efficient Multilingual Reasoning via Selective Language AlignmentInternational Conference on Computational Linguistics (COLING)Yuchun Fan, Yongyu Mu, YiLin Wang, et al.2025 · 20 citations
- The NiuTrans System for the WMT20 Quality Estimation Shared Task ↗Proceedings of the Fifth Conference on Machine Translation · no summary yetChi Hu et al.2020 · 15 citations
- Lost in Literalism: How Supervised Training Shapes Translationese in LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yafu Li, Ronghao Zhang, Zhilin Wang, et al.2025 · 12 citations
- Effective Incorporation of Source Syntax into Hierarchical Phrase-based Translation ↗Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers · no summary yetTong Xiao et al.2014 · 5 citations
- An Empirical Study of Translation Rule Extraction with Multiple Parsers ↗Coling 2010: Posters · no summary yetTong Xiao et al.2010 · 5 citations
- Improving Decoding Generalization for Tree-to-String Translation ↗Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies · no summary yetJingbo Zhu, Tong Xiao2011 · 3 citations
- Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
- BIASEDTALES-ML: A Multilingual Dataset for Analyzing Narrative Attribute Distributions in LLM-Generated StoriesFindings of the Association for Computational LinguisticsYuxuan Ouyang, Yingfeng Luo, JingBo Zhu, et al.2026
- MTR-Suite: A Framework for Evaluating and Synthesizing Conversational Retrieval BenchmarksAnnual Meeting of the Association for Computational Linguistics (ACL)Junhao Ruan, Abudukeyumu Abudula, Bei Li, et al.2026
- NiuTrans.LMT: Toward Inclusive and Scalable Multilingual Machine Translation with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yingfeng Luo, Ziqiang Xu, Yuxuan Ouyang, et al.2026
- RouteLMT: Learned Sample Routing for Hybrid LLM Translation DeploymentAnnual Meeting of the Association for Computational Linguistics (ACL)Yingfeng Luo, Hongyu Liu, DingYang Lin, et al.2026
- SERM: Self-Evolving Relevance Model with Agent-Driven Learning from Massive Query StreamsFindings of the Association for Computational LinguisticsChenglong Wang, Canjia Li, Xingzhao Zhu, et al.2026
- CoMeT: Collaborative Memory Transformer for Efficient Long Context Modeling ↗Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetRunsong Zhao et al.2026
Co-authors here
- Jingbo Zhu ×8
- Bei Li ×5
- Chenglong Wang ×3
- Yingfeng Luo ×3
- DingYang Lin ×2
- Junhao Ruan ×2
- Kaiyan Chang ×2
- Murun Yang ×2
- Qiaozhi He ×2
- Quan Du ×2
- Yongjing Yin ×2
- Yongyu Mu ×2
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×7: ACL 2026 ×3, ACL 2025, ACL 2019
- Findings of the Association for Computational Linguistics ×2: Findings of the Association for Computational Linguistics 2026 ×2
- Conference on Machine Translation (WMT) ×2
- International Conference on Computational Linguistics (COLING): COLING 2025
- Transactions of the Association for Computational Linguistics (TACL): Transactions of the Association for Computational Linguistics (TACL) 2026
- Coling 2010: Posters
- Proceedings of COLING 2014, the 25th International Conference on Computational Linguistics: Technical Papers
- Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP)
- Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies
- Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
- Proceedings of the ACL 2012 System Demonstrations
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/tong-xiao/