Who cites «Rewarded soups: towards Pareto-optimal alignment by interpolating weights fine-tuned on diverse rewards»
- A Roadmap to Pluralistic AlignmentarXiv:2402.05070Taylor Sorensen, Jared Moore, Jillian Fisher, et al.2024 · 143 citations
- Personalized Soups: Personalized Large Language Model Alignment via Post-hoc Parameter MergingarXiv:2310.11564Joel Jang, Seungone Kim, Bill Yuchen Lin, et al.2023 · 102 citations
- LLM-Rubric: A Multidimensional, Calibrated Approach to Automated Evaluation of Natural Language TextsAnnual Meeting of the Association for Computational Linguistics (ACL)Helia Hashemi, Jason Eisner, Corby Rosset, et al.2024 · 88 citations
- Mitigating the Alignment Tax of RLHFConference on Empirical Methods in Natural Language Processing (EMNLP)Yong Lin, Hangyu Lin, Wei Xiong, et al.2024 · 83 citations
- Model Merging in LLMs, MLLMs, and Beyond: Methods, Theories, Applications and OpportunitiesarXiv:2408.07666Enneng Yang, Li Shen, Guibing Guo, et al.2024 · 79 citations
- Arithmetic Control of LLMs for Diverse User Preferences: Directional Preference Alignment with Multi-Objective RewardsAnnual Meeting of the Association for Computational Linguistics (ACL)Haoxiang Wang, Yong Lin, Wei Xiong, et al.2024 · 68 citations
- Weak-to-Strong Search: Align Large Language Models via Searching over Small Language ModelsConference on Neural Information Processing Systems (NeurIPS)Zhanhui Zhou, Zhixuan Liu, Jie Liu, et al.2024 · 17 citations
- StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style ElementsJillian Fisher, Skyler Hallinan, Ximing Lu, et al.2024 · 16 citations
- Cross-Lingual Auto Evaluation for Assessing Multilingual LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Sumanth Doddapaneni, Mohammed Safi Ur Rahman Khan, Dilip Venkatesh, et al.2025 · 11 citations
- Multi-Attribute Steering of Language Models via Targeted InterventionAnnual Meeting of the Association for Computational Linguistics (ACL)Duy Nguyen, Archiki Prasad, Elias Stengel-Eskin, et al.2025 · 11 citations
- GrAInS: Gradient-based Attribution for Inference-Time Steering of LLMs and VLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Duy Nguyen, Archiki Prasad, Elias Stengel-Eskin, et al.2026 · 4 citations
- Learning to Optimize Multi-Objective Alignment Through Dynamic Reward WeightingTransactions of the Association for Computational Linguistics (TACL)Yining Lu, Zilong Wang, Shiyang Li, et al.2026 · 4 citations
- Red-Bandit: Test-Time Adaptation for LLM Red-Teaming via Bandit-Guided LoRA ExpertsAnnual Meeting of the Association for Computational Linguistics (ACL)Christos Ziakas, Nicholas Loo, Nishita Jain, et al.2026 · 2 citations
- Beyond Compromise: Pareto-Lenient Consensus for Efficient Multi-Preference LLM AlignmentFindings of the Association for Computational LinguisticsRenxuan Tan, Rongpeng Li, Zhifeng Zhao, et al.2026 · 1 citation
- MEAV: Model Editing with Alignment Vectors for inference time LLM alignment in single and multidomain preference spectrumFindings of the Association for Computational LinguisticsSadat Shahriar, Zheng Qi, Nikolaos Pappas, et al.2026 · 1 citation
- P-Check: Advancing Personalized Reward Model via Learning to Generate Dynamic ChecklistAnnual Meeting of the Association for Computational Linguistics (ACL)Kwangwook Seo, Dongha Lee2026 · 1 citation
- CARE-CR: Context-Aware Routing and Expert Fusion for Multi-Preference Cognitive RestructuringFindings of the Association for Computational LinguisticsHongzhi Qi, Liangcheng Wang, Yijing YU, et al.2026
- Self-Guided Alignment: Adaptive Preference Sensing for Multi-Objective GenerationAnnual Meeting of the Association for Computational Linguistics (ACL)Ning Wang, Zhanyang Liu, Taotao Zhou, et al.2026
- Understanding Conflicts in Multi-Objective Alignment through Reward ConsistencyFindings of the Association for Computational LinguisticsZhihao Xu, Yongqi Tong, Xin Zhang, et al.2026
- Where Paths Split: Localized, Calibrated Control of Moral Reasoning in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chenchen Yuan, Zheyu Zhang, Gjergji Kasneci2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/rame-2023-rewarded-soups-towards-pareto-optimal/cited-by/