🧑‍🔬 Piotr Nawrot

🧭 Fields, topics and concepts

Of its works in our library, with the number of works on each.

📅 Works by year

2020s

📄 Papers

The most cited first (OpenAlex and our library).

1. No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language Models (2023 · 30 citations)
   Efficient training methods for Transformer language models often claim speed-ups, but these claims tend to rest on uneven comparisons.
2. The Sparse Frontier: Sparse Attention Trade-offs in Transformer LLMs (2026 · 10 citations)
   Running Transformer LLMs on long inputs is costly. Prefilling cost grows quadratically with input length, and decoding slows down because each step must read an ever-larger KV cache. Many sparse attention techniques promise savings, but it has been unclear how much accuracy they give up in return. The authors present…

🤝 Co-authors here

5 co-authors with a page, the most papers together first.

• Edoardo Maria Ponti
• Jean Kaddour
• Kelly Marchisio
• Pasquale Minervini
• Sebastian Ruder

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

• Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2026

🔗 Cited by

Papers of our library cite their works 31 times (of the 149,439 papers whose bibliographies we read); 6 citing papers with a page here →.

Updated 3 November 2026

This page in Markdown → https://md.research.elamur.ai/free/en/authors/piotr-nawrot/