Shamane Siriwardhana
Shamane Siriwardhana has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining, Question answering, Information retrieval & search; often with Vladimir Karpukhin.
OpenAlex · ORCID · h-index 6 · 22 works · 701 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 178 times in our library · ⭐ Paper Stars ranking: #3346
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 work
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 1 workInformation retrieval & search · 1 workQuestion answering · 1 work
Works by year
2020s
Papers
- Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering (2023 · 403 citations)
RAG combines a DPR retriever with a BART generator and an external knowledge base. It was developed and tested only with Wikipedia, and its passage encodings and index stay frozen during fine-tuning. This makes its transfer to specialized fields uncertain. The authors present RAG-end2end, which jointly trains the… - Arcee's MergeKit: A Toolkit for Merging Large Language Models (2024 · 101 citations)
Fine-tuning a separate LLM for every task is costly to store and deploy. It can also erode general abilities through catastrophic forgetting, and it stops related tasks from benefiting one another. Model merging addresses this by combining the parameters of existing checkpoints into a single model with no extra…
Co-authors here
Venues
- Transactions of the Association for Computational Linguistics (TACL): Transactions of the Association for Computational Linguistics (TACL) 2023
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shamane-siriwardhana/