Jonathan Frankle
Jonathan Frankle has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Christopher D. Manning, David Hall, Michihiro Yasunaga.
OpenAlex · h-index 18 · 48 works · 3,151 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 94 times in our library · ⭐ Paper Stars ranking: #6359
Affiliations
Fields, topics and concepts
📚 Shelves 9The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 workBiochemistry, Genetics and Molecular Biology · 1 workHealth Informatics · 1 workMedicine · 1 workMolecular Biology · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 2 works
💡 Concepts 1Key ideas and methods explained on our concept pages.Scaling laws · 1 work
Works by year
2020s
Papers
- BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text (2024 · 79 citations)
Frontier systems such as GPT-4 and Med-PaLM 2 perform very well on biomedical NLP. However, they are huge, expensive, reachable only through remote APIs (a problem for patient privacy) and trained on undisclosed data. The authors ask whether a much smaller, domain-focused model can be competitive. They built… - Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling Laws (2024 · 57 citations)
The Chinchilla scaling laws suggest how to divide a compute budget between the number of parameters and the amount of training data.
Co-authors here
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jonathan-frankle/