Chen Liang
Chen Liang has 3 papers in our library, in 2021–2024, most of them on Language models & pretraining; often with Yelong Shen, David Patterson, David R. So.
OpenAlex · ORCID · Wikidata · h-index 38 · 329 works · 5,901 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 399 times in our library · 6 more in our library without a page yet · ⭐ Paper Stars ranking: #4420
Affiliations
Fields, topics and concepts
📚 Shelves 9The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksEngineering · 1 workElectrical and Electronic Engineering · 1 workHardware and Architecture · 1 workInformation Systems · 1 workArts and Humanities · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- Carbon Emissions and Large Neural Network Training (2021 · 323 citations)
The paper asks how much electricity and greenhouse-gas output (CO2e) the training of large NLP models actually requires. - Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling (2024 · 59 citations)
Language models struggle with very long inputs. Full attention scales quadratically with sequence length, while state space models (SSMs) are linear but recall specific details poorly. The authors propose Samba, a hybrid that stacks Mamba layers, SwiGLU MLPs and Sliding Window Attention (SWA, window 2048) in… - GRIN: GRadient-INformed MoE (2024 · 7 citations)
Mixture-of-Experts (MoE) models activate only a few expert subnetworks per token. However, the discrete routing step has no true gradient, so standard training substitutes the gating gradient. Large-scale MoE training also usually relies on expert parallelism, which forces capacity limits and discards overflow…
All works
- Carbon Emissions and Large Neural Network TrainingarXiv:2104.10350David Patterson, Joseph Gonzalez, Quoc Le, et al.2021 · 323 citations
- Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
- Geometric Anchor Correspondence Mining with Uncertainty Modeling for Universal Domain Adaptation ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetLiang Chen et al.2022 · 51 citations
- Hierarchical Curriculum Learning for AMR Parsing ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers) · no summary yetPeiyi Wang et al.2022 · 18 citations
- Athena: Retrieval-augmented Legal Judgment Prediction with Large Language Models ↗arXiv:2410.11195 · no summary yetXiao Peng, Liang Chen2024 · 8 citations
- GRIN: GRadient-INformed MoEarXiv:2409.12136Liyuan Liu, Young Jin Kim, Shuohang Wang, et al.2024 · 7 citations
- Guiding AMR Parsing with Reverse Graph Linearization ↗Findings of the Association for Computational Linguistics: EMNLP 2023 · no summary yetBofei Gao et al.2023 · 4 citations
- Unified Functional Hashing in Automatic Machine Learning ↗arXiv (Cornell University) · no summary yetRyan Gillard et al.2023 · 2 citations
- A new diagnostic system for J-E translation ILTS by global matching algorithm and POST parser ↗Proceedings of Machine Translation Summit VII · no summary yetLiang Chen, Naoyuki Tokuda1999 · 1 citation
Co-authors here
- Yelong Shen ×2
- David Patterson
- David R. So
- Hao Cheng
- Jeff Dean
- Joseph E. Gonzalez
- Liliang Ren
- Liyuan Liu
- Masahiro Tanaka
- Quoc Viet Le
- Shuohang Wang
- Vishrav Chaudhary
Venues
- Findings of the Association for Computational Linguistics
- Findings of the Association for Computational Linguistics: EMNLP 2023
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings
- Proceedings of Machine Translation Summit VII
- Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/chen-liang/