Pratyush Maini
Pratyush Maini has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Avi Schwarzschild, David Grangier, J. Zico Kolter.
OpenAlex · h-index 7 · 32 works · 366 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 215 times in our library · ⭐ Paper Stars ranking: #6118
Affiliations
Fields, topics and concepts
📚 Shelves 7The field of science this work belongs to (OpenAlex fields).Computer Science · 2 worksArtificial Intelligence · 2 worksSafety Research · 1 workSocial Sciences · 1 workArts and Humanities · 1 workInformation Systems · 1 workLanguage and Linguistics · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
Works by year
2020s
Papers
- TOFU: A Task of Fictitious Unlearning for LLMs (2024 · 144 citations)
LLMs can memorize and reveal private details about people. "Unlearning" means adjusting a trained model so it forgets particular data. However, it has been hard to tell whether existing unlearning methods produce a model that behaves like one that never saw that data. TOFU (Task of Fictitious Unlearning) addresses… - Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling (2024 · 90 citations)
Pre-training large language models on raw web crawls is costly. Web text is noisy and badly written, scaling laws call for ever more compute and tokens, and the supply of high-quality text is limited. The authors introduce WRAP (Web Rephrase Augmented Pre-training). An off-the-shelf instruction-tuned model, such as…
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/pratyush-maini/