Elamur Research⌕
☰
home / authors / Orion Weller

Orion Weller

Orion Weller has 4 papers in our library, in 2019–2025, most of them on Multilingual & cross-lingual NLP, Efficient models & compression; often with Antoine Chaffin, Benjamin Van Durme, Faisal Ladhak.

4 papers in our library · 2019–2025

OpenAlex · ORCID · Wikidata · h-index 13 · 74 works · 736 citations OpenAlex, 2026-10-14

📄 4 works in our library · 🔗 884 citations in our library · 6 more in our library without a page yet · ⭐ Paper Star rank #2791

The profile is the library's match of the name; two people with one name are not always told apart.

Elsewhere: Google Scholar · Semantic Scholar · dblp · ACL Anthology

 Affiliations

🎓Johns Hopkins UniversityBaltimore · United States2021–2026 · 45 paperscurrent🎓Brigham Young UniversityProvo · United States2019–2022 · 10 papers🔬Allen Institute for Artificial IntelligenceSeattle · United States2024 · 4 papers🎓University of GlasgowGlasgow · United Kingdom2024–2025 · 3 papers🎓Yale UniversityNew Haven · United States2024–2025 · 3 papers🎓University of ArizonaTucson · United States2024 · 3 papers🎓Institut Polytechnique de ParisPalaiseau · France2024–2025 · 2 papers🎓Télécom ParisPalaiseau · France2024–2025 · 2 papers🎓University of Maryland, College ParkCollege Park · United States2023–2024 · 2 papers

From the bylines of their papers (OpenAlex, 2026-10-14), ORCID and Wikidata; institutions on papers are matched by machine. 1 more institution on single bylines are not listed.

 Concepts, shelves and topics

Of its works in our library: the number of works on each and its rating among them.

📚 Shelves 7 Arts and Humanities · 4 works Computer Science · 4 works Artificial Intelligence · 4 works Language and Linguistics · 4 works Information Systems · 1 work Psychology · 1 work Social Psychology · 1 work

🧭 Topics 2 Efficient models & compression · 1 work Multilingual & cross-lingual NLP · 1 work

 Works by year

2020s

20251 paper20241 paper20201 paper

2010s

20191 paper

 Papers

The most cited first (OpenAlex and our library).

  1. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and Inference (2024 · 355 citations)
    BERT-style encoders still power many retrieval, classification and RAG pipelines, yet most deployments rely on old models.
  2. Humor Detection: A Transformer Gets the Last Laugh (2019 · 165 citations)
    The paper moves past simply spotting jokes in text and asks a harder question: can a model predict whether a joke will actually be judged funny? The authors build a rated-joke dataset by repeatedly scraping Reddit's r/Jokes forum and updating upvote counts.
  3. Learning from Task Descriptions (2020 · 111 citations)
    Most NLP systems learn a new task only after seeing thousands of labeled examples. Humans can often do the same task just by reading instructions. The authors propose "learning from task descriptions" as a general framework for this. A model receives both an input and a natural-language description of the task, and…
  4. mmBERT: A Modern Multilingual Encoder with Annealed Language Learning (2025 · 59 citations)
    Multilingual encoder-only models have seen little progress in recent years, and XLM-R remains the default choice despite being more than six years old.

All works

10 works of theirs in our library, the most cited first; 4 with a page here, the others link their original until we summarise them.

  1. Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.arXiv:2412.13663 · 355 citations
  2. Humor Detection: A Transformer Gets the Last LaughOrion Weller, Kevin SeppiConference on Empirical Methods in Natural… · 165 citations
  3. Learning from Task DescriptionsOrion Weller, Nicholas Lourie, Matt Gardner, et al.Conference on Empirical Methods in Natural… · 111 citations
  4. mmBERT: A Modern Multilingual Encoder with Annealed Language LearningMarc Marone, Orion Weller, William Fleshman, et al.arXiv:2509.06888 · 59 citations
  5. “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training Data (original ↗)Orion Weller et al.2024 · Proceedings of the 18th Conference of the… · 44 citations · no summary yet
  6. FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions (original ↗)Orion Weller et al.2025 · Proceedings of the 2025 Conference of the… · 39 citations · no summary yet
  7. CLERC: A Dataset for U. S. Legal Case Retrieval and Retrieval-Augmented Analysis Generation (original ↗)Abe Bohan Hou et al.2025 · Findings of the Association for Computational… · 28 citations · no summary yet
  8. Can Humor Prediction Datasets be used for Humor Generation? Humorous Headline Generation via Style Transfer (original ↗)Orion Weller, Nancy Fulda, Kevin Seppi2020 · Proceedings of the Second Workshop on… · 23 citations · no summary yet
  9. CLERC: A Dataset for Legal Case Retrieval and Retrieval-Augmented Analysis Generation (original ↗)Abe Bohan Hou et al.2024 · arXiv:2406.17186 · 21 citations · no summary yet
  10. Enhancing Systematic Decompositional Natural Language Inference Using Informal Logic (original ↗)Nathaniel Weir et al.2024 · Proceedings of the 2024 Conference on Empirical… · 7 citations · no summary yet

 Co-authors here

7 co-authors with a page, the most papers together first.

Venues

Where their works here were published, the most works first, with the editions of those that have a page.

 Cited by

Papers of our library cite their works 884 times (of the 141,840 papers whose bibliographies we read); 60 citing papers with a page here →.

Updated

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/orion-weller/