Andrew Mattarella-Micke
Andrew Mattarella-Micke has 2 papers in our library, in 2020–2021, most of them on Language models & pretraining; often with Mohit Iyyer, Adam Trischler, Alessandro Sordoni.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 152 times in our library · ⭐ Paper Stars ranking: #4230
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
20211 paperAndrew Mattarella-Micke's papers of 202120201 paperAndrew Mattarella-Micke's papers of 2020
Papers
- Exploring and Predicting Transferability across NLP Tasks (2020 · 192 citations)
Fine-tuning BERT on an intermediate task before the target task can help, but it was unclear when this works and which source task to pick. - Do Long-Range Language Models Actually Use Long-Range Context? (2021 · 100 citations)
Long-range Transformer language models can now read thousands of tokens of preceding text, and they reach lower perplexity on benchmarks such as PG-19.
Co-authors here
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/andrew-mattarella-micke/