Oskar van der Wal
Oskar van der Wal has 3 papers in our library, in 2022–2023, most of them on Language models & pretraining, Bias, fairness & safety, English; often with Willem Zuidema, Arianna Bisazza, Gabriele Sarti.
OpenAlex · ORCID · Wikidata · h-index 7 · 22 works · 1,220 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 1,483 times in our library · 1 more in our library without a page yet · ⭐ Paper Stars ranking: #6374
Affiliations
Fields, topics and concepts
📚 Shelves 8The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 3 worksArts and Humanities · 3 worksComputer Science · 3 worksLanguage and Linguistics · 3 worksBiochemistry, Genetics and Molecular Biology · 1 workMolecular Biology · 1 workSafety Research · 2 worksSocial Sciences · 2 works
🧭 Topics 4Research subjects and languages the work is about.Interpretability · 1 workBias, fairness & safety · 2 worksEnglish · 2 worksLanguage models & pretraining · 2 works
Works by year
2020s
Papers
- Inseq: An Interpretability Toolkit for Sequence Generation Models (2023 · 97 citations)
Most feature attribution research and tooling in NLP targets classification, where each input token gets a single importance score. - Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language Model (2023 · 19 citations)
The paper asks whether gender bias in a language model can be traced to specific internal parts and then reduced by retraining only those parts. - The Birth of Bias: A case study on the evolution of gender bias in an English language model (2022 · 19 citations)
Most work on gender bias in language models detects or removes it after training. This paper asks a prior question: how does a model become biased while it learns? The authors chose a small, fully transparent setup, an LSTM language model trained on an English Wikipedia corpus. They had complete access to the…
All works
- BLOOM: A 176B-Parameter Open-Access Multilingual Language Model ↗arXiv:2211.05100 · no summary yetBigScience Workshop et al.2022 · 1,606 citations
- Inseq: An Interpretability Toolkit for Sequence Generation ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Gabriele Sarti, Nils Feldhus, Ludwig Sickert, et al.2023 · 97 citations
- Identifying and Adapting Transformer-Components Responsible for Gender Bias in an English Language ModelBlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLPAbhijith Chintam, Rahel Beloch, Willem Zuidema, et al.2023 · 19 citations
- The Birth of Bias: A case study on the evolution of gender bias in an English language modelWorkshop on Gender Bias in Natural Language ProcessingOskar Van Der Wal, Jaap Jumelet, Katrin Schulz, et al.2022 · 19 citations
Co-authors here
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2023
- BigScience Episode – Workshop on Challenges & Perspectives in Creating Large Language Models
- BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP: BlackboxNLP Workshop on Analyzing and Interpreting Neural Networks for NLP 2023
- Workshop on Gender Bias in Natural Language Processing: Workshop on Gender Bias in Natural Language Processing 2022
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/oskar-van-der-wal/