Zhenyu Zhang
Zhenyu Zhang has 4 papers in our library, in 2022–2026, most of them on Language models & pretraining, Efficient models & compression; often with Yu Sun, Haifeng Wang, Hua Ren Wu.
OpenAlex · ORCID · h-index 39 · 276 works · 4,756 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 56 times in our library · ⭐ Paper Stars ranking: #7469
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 4 worksComputer Science · 4 worksArtificial Intelligence · 4 worksLanguage and Linguistics · 4 worksComputer Vision and Pattern Recognition · 2 worksHealth Information Management · 1 workHealth Professions · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workEfficient models & compression · 1 work
Works by year
2020s
Papers
- ERNIE-Layout: Layout Knowledge Enhanced Pre-training for Visually-rich Document Understanding (2022 · 40 citations)
Most document pre-training models treat layout as a 2D extension of 1D positions and serialize OCR output in raster-scan order (top-to-bottom, left-to-right). - Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking (2025 · 16 citations)
Larger LLMs bring diminishing returns, and small models hit capacity limits. Chain-of-Thought style test-time scaling also has a weakness: it only works if the model produces the critical tokens correctly. The authors trained GPT-2 on AQuA and tracked gradient norms layer by layer. Tokens the model gets right settle… - BeamLoRA: Beam-Constraint Low-Rank Adaptation (2025 · 6 citations)
Low-Rank Adaptation (LoRA) is an efficient way to fine-tune large language models, but its accuracy still has room to improve. - CPTCoder: A Reliable LLM System for Medical Procedure Code Prediction (2026 · 1 citation)
CPTCoder targets automatic assignment of Current Procedural Terminology (CPT) codes to clinical reports. This is a long-tailed, multi-label task in which codes are five-digit identifiers, so a single wrong digit names a different billable procedure. The authors fine-tune Llama-3.1-8B-Instruct with LoRA. They add…
Co-authors here
- Yu Sun ×3
- Haifeng Wang ×2
- Hua Ren Wu ×2
- Shuohuan Wang ×2
- Arman Cohan
- Benlu Wang
- Jiawei Sheng
- Junyuan Shang
- Peng Fu
- Qiming Peng
- Shikun Feng
- Tingwen Liu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhenyu-zhang/