Anuj Sharma
Anuj Sharma has 2 papers in our library, in 2026, most of them on Language models & pretraining.
OpenAlex · ORCID · Wikidata · h-index 32 · 135 works · 4,923 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 1 time in our library · ⭐ Paper Stars ranking: #11435
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
💡 Concepts 1Key ideas and methods explained on our concept pages.Latent semantic indexing · 1 work
Works by year
2020s
Papers
- Beyond Variance: Knowledge-Aware LLM Compression via Fisher-Aligned Subspace Diagnostics (2026 · 1 citation)
Post-training activation compression helps fit LLMs onto limited hardware. Standard SVD-style methods keep the directions with the largest activation variance and ignore how strongly the loss depends on each direction. The authors argue that this harms factual knowledge, which often sits in low-variance but… - FedReFT: Federated Representation Fine-Tuning with All-But-Me Aggregation (2026)
The paper brings Representation Fine-Tuning (ReFT) into federated learning. ReFT adapts a frozen model by editing its hidden activations, not its weights. The federated setting is hard because clients pursue different tasks, and simply averaging representation edits with FedAvg can break their semantic alignment.
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2026
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/anuj-sharma/