Wonho Song
Wonho Song has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Chanjun Park, Dahyun Kim, Hyeonwoo Kim.
OpenAlex · h-index 1 · 1 works · 2 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 87 times in our library · ⭐ Paper Stars ranking: #6892
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksLanguage and Linguistics · 2 worksComputer Vision and Pattern Recognition · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scaling (2023 · 77 citations)
Scaling up LLMs usually means training ever-larger networks or adopting mixture-of-experts designs, which complicate training and inference pipelines. - sDPO: Don't Use Your Data All at Once (2024 · 19 citations)
Direct Preference Optimization (DPO) aligns an LLM by comparing its log-probability ratios for chosen and rejected responses against those of a frozen reference model.
Co-authors here
- Chanjun Park ×2
- Dahyun Kim ×2
- Hyeonwoo Kim ×2
- Sanghoon Kim ×2
- Yungi Kim ×2
- Yunsu Kim ×2
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/wonho-song/