Akhiad Bercovich
Akhiad Bercovich has 4 papers in our library, in 2025, most of them on Reasoning, Language models & pretraining; often with Abhinav Khattar, Aleksander Ficek, Aarti Basant.
OpenAlex · h-index 1 · 13 works · 4 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 187 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #5855
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 4 worksComputer Science · 4 worksArtificial Intelligence · 4 worksComputer Vision and Pattern Recognition · 4 worksLanguage and Linguistics · 4 works
🧭 Topics 2Research subjects and languages the work is about.Reasoning · 3 worksLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- Llama-Nemotron: Efficient Reasoning Models (2025 · 76 citations)
Reasoning-oriented language models write long chains of thought, so inference cost increasingly limits how useful they are. - NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning Model (2025 · 39 citations)
Reasoning models spend most of their compute producing long chains of thought. In standard Transformers, the attention KV cache makes such long generations slow and memory-hungry. NVIDIA addresses this with Nemotron-Nano-9B-v2, which uses the Nemotron-H hybrid design: most self-attention layers are replaced by… - Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer Models (2025 · 38 citations)
Self-attention costs grow with sequence length, both in compute per generated token and in KV-cache memory. - Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning (2025 · 27 citations)
NVIDIA presents Nemotron 3 Nano 30B-A3B, an open language model for agentic use, reasoning and chat that aims for a better balance between accuracy and inference speed.
All works
- Llama-Nemotron: Efficient Reasoning ModelsarXiv:2505.00949Akhiad Bercovich, Itay Levy, Izik Golan, et al.2025 · 76 citations
- NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning ModelarXiv:2508.14444NVIDIA: Aarti Basant, Abhijit Khairnar, Abhijit Paithankar, et al.2025 · 39 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic ReasoningarXiv:2512.20848NVIDIA: Aaron Blakeman, Aaron Grattafiori, Aarti Basant, et al.2025 · 27 citations
- Puzzle: Distillation-Based NAS for Inference-Optimized LLMs ↗arXiv:2411.19146 · no summary yetAkhiad Bercovich et al.2024 · 10 citations
Co-authors here
- Abhinav Khattar ×3
- Aleksander Ficek ×3
- Aarti Basant ×2
- Adithya Renduchintala ×2
- Alex Kondratenko ×2
- NVIDIA: Aaron Blakeman ×2
- Aaron Grattafiori
- Ameya Sunil Mahabaleshwarkar
- Andrew Tao
- Itay Levy
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/akhiad-bercovich/