Virginia Adams
Virginia Adams has 2 papers in our library, in 2024, most of them on Language models & pretraining; often with Aidan Swope, Anton Alexandrov, Ben Athiwaratkun.
No OpenAlex profile matched yet.
📄 2 works in our library · 🔗 Cited 277 times in our library · ⭐ Paper Stars ranking: #4122
Concepts, shelves and topics
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 workInformation Systems · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- RedPajama: an Open Dataset for Training Large Language Models (2024 · 247 citations)
Many leading LLMs are trained on data whose sources and cleaning steps are never disclosed. This makes open research on pretraining corpora slow and hard to replicate. The authors respond with two public releases. RedPajama-V1 rebuilds the LLaMA-1 training mixture from its brief published description and records… - HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM (2024 · 69 citations)
Open helpfulness preference datasets usually give only an overall rating or a pairwise ranking. They do not say why one answer is better, so trained models can pick up shallow cues, such as preferring longer replies whether or not they are useful. The NVIDIA team built HelpSteer to address this. It is a…
Co-authors here
- Aidan Swope
- Anton Alexandrov
- Ben Athiwaratkun
- Daniel Fu
- Huu Nguyen
- Jiaqi Zeng
- Neel Kant
- Quentin Anthony
- Rahul Chalamala
- Yonatan Oren
- Zhilin Wang
Venues
- Conference of the North American Chapter of the Association for Computational Linguistics (NAACL): NAACL 2024
- Conference on Neural Information Processing Systems (NeurIPS): NeurIPS 2024
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/virginia-adams/