Elamur Research⌕
☰
home / authors / Mingjie Sun

Mingjie Sun

Mingjie Sun has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with J. Zico Kolter, Liqun Ma, Xinlei Chen.

2 papers in our library · 2024

OpenAlex · ORCID · h-index 18 · 90 works · 1,875 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 181 times in our library · 3 more in our library without a page yet · ⭐ Paper Stars ranking: #8036

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓Soochow UniversitySuzhou · China2023–2026 · 16 paperscurrent🎓Xi’an Jiaotong-Liverpool UniversitySuzhou · China2020–2026 · 13 paperscurrent🏢KuaishouBeijing · China2025–2026 · 4 paperscurrent🎓Beijing Normal UniversityBeijing · China2026 · 2 paperscurrent🏢State Grid Corporation of ChinaBeijing · China2011–2024 · 8 papers🎓University of LiverpoolLiverpool · United Kingdom2020–2022 · 7 papers🎓Southeast UniversityNanjing · China2008–2013 · 7 papers🎓Carnegie Mellon UniversityPittsburgh · United States2020–2025 · 5 papers🎓Taishan UniversityTai’an · China2008–2023 · 5 papers🎓Zhejiang UniversityHangzhou · China2009–2023 · 4 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 12 more institutions on single bylines are not listed.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 works

🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works

 Works by year

2020s

20242 papers

 Papers

The most cited first (OpenAlex and our library).

  1. Massive Activations in Large Language Models (2024 · 88 citations)
    The paper looks at the internal hidden states of LLMs and reports a strange phenomenon. A tiny handful of scalar activations, often fewer than ten among tens of millions, reach magnitudes thousands to tens of thousands of times above the typical value. The authors call these "massive activations." They examine many…
  2. FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive Distillation (2024 · 7 citations)
    Binarizing LLMs down to pure 1-bit weights could greatly cut memory and compute. Earlier approaches fall short of that limit. Some keep salient weights at higher precision (PB-LLM, BiLLM), and BitNet b1.58 uses ternary values. Others start from a pretrained full-precision model, which locks in its size and vocabulary…

All works

5 works of theirs in our library, the most cited first; 2 with a page here, the others link their original until we summarise them.

  1. Rethinking the Value of Network Pruning ↗arXiv (Cornell University) · no summary yetZhuang Liu et al.2018 · 960 citations
  2. Reliability Does Matter: An End-to-End Weakly Supervised Semantic Segmentation Approach ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetBingfeng Zhang et al.2020 · 209 citations
  3. Massive Activations in Large Language ModelsarXiv:2402.17762Mingjie Sun, Xinlei Chen, J. Zico Kolter, et al.2024 · 88 citations
  4. Data Poisoning Attack against Unsupervised Node Embedding Methods ↗arXiv (Cornell University) · no summary yetMingjie Sun et al.2018 · 39 citations
  5. FBI-LLM: Scaling Up Fully Binarized LLMs from Scratch via Autoregressive DistillationarXiv:2407.07093Liqun Ma, Mingjie Sun, Zhiqiang Shen2024 · 7 citations

 Co-authors here

5 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 181 times (of the 149,439 papers whose bibliographies we read); 36 citing papers with a page here →.

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/mingjie-sun/