Da Zheng
Da Zheng has 4 papers in our library, in 2025–2026, most of them on Language models & pretraining, Reasoning, Knowledge graphs & ontologies; often with Huajun Chen, Ningyu Zhang, Lun Du.
OpenAlex · h-index 9 · 66 works · 193 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 55 times in our library · ⭐ Paper Stars ranking: #8711
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Computer Science · 4 worksArts and Humanities · 3 worksArtificial Intelligence · 4 worksComputer Vision and Pattern Recognition · 3 worksLanguage and Linguistics · 3 worksDecision Sciences · 1 workInformation Systems · 1 workInformation Systems and Management · 1 work
🧭 Topics 4Research subjects and languages the work is about.Efficient models & compression · 1 workLanguage models & pretraining · 1 workReasoning · 1 workKnowledge graphs & ontologies · 1 work
Works by year
2020s
Papers
- LightThinker: Thinking Step-by-Step Compression (2025 · 50 citations)
Slow, o1-style reasoning makes LLMs produce very long token sequences. Because attention cost grows quadratically and the KV Cache grows linearly with context, these outputs are expensive in memory and time. LightThinker addresses this by teaching a model to condense each intermediate reasoning step as it goes. After… - Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models (2025 · 7 citations)
Extending large language models to very long contexts is difficult for three reasons. Natural documents of 32K–128K tokens are scarce. Upsampling long data shifts the training distribution and can hurt short-context skills. Attention over long sequences is also expensive. The authors propose Untie the Knots (UtK), an… - KnowRL: Exploring Knowledgeable Reinforcement Learning for Factuality (2026 · 5 citations)
Slow-thinking LLMs such as DeepSeek-R1 distillations reason well but hallucinate heavily. One reason is that standard RL rewards only the final answer, so invented reasoning steps still get reinforced whenever the answer happens to be right. KnowRL addresses this by adding factual supervision to the reasoning trace… - What Makes AI Research Replicable? Executable Knowledge Graphs as Scientific Knowledge Representations (2026)
LLM agents that try to reproduce AI papers often fail to produce working code. Papers leave out implementation specifics, and standard RAG does not recover technical details buried in cited works or the code signals in related repositories. The authors propose Executable Knowledge Graphs (xKG), a plug-in knowledge…
Co-authors here
- Huajun Chen ×3
- Ningyu Zhang ×3
- Lun Du ×2
- Shuofei Qiao ×2
- Yujie Luo ×2
- Yuqi Zhu ×2
- Debing Zhang
- Jintian Zhang
- Junfeng Tian
- Mengshu Sun
- Rui Wang
- Yang Chen
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×3: ACL 2026 ×2, ACL 2025
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2025
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/da-zheng/