Margaret Li
Margaret Li has 2 papers in our library, in 2020–2021, most of them on Dialogue systems, Bias, fairness & safety; often with Jason Weston, Y-Lan Boureau, Da Ju.
OpenAlex · ORCID · Wikidata · h-index 13 · 33 works · 1,589 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 443 times in our library · 4 more in our library without a page yet · ⭐ Paper Stars ranking: #3943
Affiliations
Concepts, shelves and topics
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Dialogue systems · 2 worksBias, fairness & safety · 1 work
Works by year
2020s
Papers
- Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training (2020 · 215 citations)
Generative dialogue models trained only with maximum likelihood show several weaknesses. They copy too much from the context, repeat n-grams inside a single reply, overuse frequent tokens, and can contradict what was said earlier. The authors extend the unlikelihood loss of Welleck et al. (2019a) into a general… - Bot-Adversarial Dialogue for Safe Conversational Agents (2021 · 139 citations)
Open-domain chatbots trained on large human conversation corpora can pick up toxic behavior. Most safety work has studied human-written text, not what bots say when users deliberately provoke them. The authors propose Bot-Adversarial Dialogue (BAD), a human-and-model-in-the-loop framework. Crowdworkers chat with…
All works
- Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood TrainingAnnual Meeting of the Association for Computational Linguistics (ACL)Margaret Li, Stephen Roller, Ilia Kulikov, et al.2020 · 215 citations
- Recipes for Safety in Open-domain ChatbotsarXiv:2010.07079 · original ↗ · no summary yetJing Xu et al.2020 · 198 citations
- Bot-Adversarial Dialogue for Safe Conversational AgentsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Jing Xu, Da Ju, Margaret Li, et al.2021 · 139 citations
- Branch-Train-Merge: Embarrassingly Parallel Training of Expert Language ModelsarXiv:2208.03306 · original ↗ · no summary yetMargaret Li et al.2022 · 108 citations
- In-context Pretraining: Language Modeling Beyond Document BoundariesarXiv:2310.10638 · original ↗ · no summary yetWeijia Shi et al.2023 · 55 citations
- Breaking the Curse of Multilinguality with Cross-lingual Expert Language ModelsProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · original ↗ · no summary yetTerra Blevins et al.2024 · 41 citations
Co-authors here
- Jason Weston ×2
- Y-Lan Boureau ×2
- Da Ju
- Emily Dinan
- Ilia Kulikov
- Jing Xu
- Kyunghyun Cho
- Sean Welleck
- Stephen Roller
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2020
- Conference of the North American Chapter of the Association for Computational Linguistics (NAACL): NAACL 2021
- Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/margaret-li/