Elamur Research⌕
☰
home / authors / Wenge Rong

Wenge Rong

Wenge Rong has 2 papers in our library, in 2022–2023, most of them on Interpretability; often with Jie Zhou, Xiaofeng Zhang, Yikang Shen.

2 papers in our library · 2022–2023

OpenAlex · h-index 6 · 17 works · 431 citations OpenAlex, 2026-10-14

📄 2 works in our library · 🔗 Cited 128 times in our library · ⭐ Paper Stars ranking: #7171

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine.

 Fields, topics and concepts

Of its works in our library, with the number of works on each.

 Works by year

2020s

 Papers

The most cited first (OpenAlex and our library).

  1. Transformer-Patcher: One Mistake worth One Neuron (2023 · 123 citations)
    Deployed language models keep producing new errors, yet most Model Editing (ME) research fixes only a single mistake at a time.
  2. Mixture of Attention Heads: Selecting Attention Heads Per Token (2022 · 44 citations)
    Sparse Mixture-of-Experts (MoE) layers in Transformers have mostly replaced the feed-forward block. Multi-head attention has received little such treatment, even though earlier analyses showed that individual heads specialize. This paper introduces Mixture of Attention Heads (MoA), in which a pool of attention…

 Co-authors here

5 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 128 times (of the 149,439 papers whose bibliographies we read); 22 citing papers with a page here →.

Updated

This page in Markdown → https://md.research.elamur.ai/free/en/authors/wenge-rong/