Zhicheng Liu
Zhicheng Liu has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Interpretability, English; often with Fangcheng Liu, Hanting Chen, Kai Han.
OpenAlex · ORCID · Wikidata · h-index 28 · 104 works · 3,581 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 10 times in our library · ⭐ Paper Stars ranking: #9577
Affiliations
Fields, topics and concepts
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksComputer Science · 2 worksArts and Humanities · 1 workLanguage and Linguistics · 1 work
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 1 workEnglish · 1 workInterpretability · 1 work
Works by year
2020s
Papers
- PanGu-π: Enhancing Language Model Architectures via Nonlinearity Compensation (2023 · 10 citations)
Progress in large language models has mostly come from adding parameters and data. The design of the Transformer block itself gets little attention, even though large models are costly to run. The authors study LLaMA-style decoders and identify feature collapse: a rank metric shows token representations growing more… - WordDecipher: Enhancing Digital Workspace Communication with Explainable AI for Non-native English Speakers (2024 · 4 citations)
Non-native English speakers (NNES) often write workplace emails and chat messages that carry unintended social signals.
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/zhicheng-liu/