Jiawei Sheng
Jiawei Sheng has 3 papers in our library, in 2025–2026, most of them on Reasoning; often with Tingwen Liu, Wenyuan Zhang, Haifeng Wang.
OpenAlex · ORCID · Wikidata · h-index 13 · 54 works · 776 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 61 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #9873
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksLanguage and Linguistics · 3 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Reasoning · 1 work
Works by year
2020s
Papers
- Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking (2025 · 16 citations)
Larger LLMs bring diminishing returns, and small models hit capacity limits. Chain-of-Thought style test-time scaling also has a weakness: it only works if the model produces the critical tokens correctly. The authors trained GPT-2 on AQuA and tracked gradient norms layer by layer. Tokens the model gets right settle… - Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key Information (2025 · 10 citations)
Small language models are cheaper to deploy than large ones but reason less well. Chain-of-Thought (CoT) distillation usually just trains them on teacher-written rationales, with every token weighted the same. The authors observe that teacher models such as Llama3-8B shift their attention from step to step toward the… - HyperMem: Hypergraph Memory for Long-Term Conversations (2026)
Conversational agents need memory that persists across long dialogues, but their context windows are fixed.
All works
- Adaptive Attentional Network for Few-Shot Knowledge Graph Completion ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetJiawei Sheng et al.2020 · 147 citations
- CasEE: A Joint Learning Framework with Cascade Decoding for Overlapping Event Extraction ↗Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yetJiawei Sheng et al.2021 · 96 citations
- Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal ThinkingAnnual Meeting of the Association for Computational Linguistics (ACL)Yilong Chen, Junyuan Shang, Zhenyu Zhang, et al.2025 · 16 citations
- Improving Reasoning Capabilities in Small Models through Mixture-of-layers Distillation with Stepwise Attention on Key InformationConference on Empirical Methods in Natural Language Processing (EMNLP)Yao Chen, Jiawei Sheng, Wenyuan Zhang, et al.2025 · 10 citations
- HyperMem: Hypergraph Memory for Long-Term ConversationsAnnual Meeting of the Association for Computational Linguistics (ACL)Juwei Yue, Chuanrui Hu, Jiawei Sheng, et al.2026
Co-authors here
- Tingwen Liu ×3
- Wenyuan Zhang ×2
- Haifeng Wang
- Hua Ren Wu
- Junyuan Shang
- Juwei Yue
- Li Guo
- Shuohuan Wang
- Yao Chen
- Yu Sun
- Zhenyu Zhang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL) ×2: ACL 2026, ACL 2025
- Conference on Empirical Methods in Natural Language Processing (EMNLP) ×2: EMNLP 2025
- Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jiawei-sheng/