Who cites «From r to Q*: Your Language Model is Secretly a Q-Function»
- Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-ExpertsFindings of the Association for Computational LinguisticsHaoxiang Wang, Wei Xiong, Tengyang Xie, et al.2024 · 153 citations
- Iterative Reasoning Preference OptimizationConference on Neural Information Processing Systems (NeurIPS)Richard Yuanzhe Pang, Weizhe Yuan, Kyunghyun Cho, et al.2024 · 153 citations
- Process Reinforcement through Implicit RewardsarXiv:2502.01456Ganqu Cui, Lifan Yuan, Zefan Wang, et al.2025 · 151 citations
- Skywork-Reward: Bag of Tricks for Reward Modeling in LLMsarXiv:2410.18451Chris Yuhao Liu, Liang Zeng, Jiacai Liu, et al.2024 · 112 citations
- Smaug: Fixing Failure Modes of Preference Optimisation with DPO-PositivearXiv:2402.13228Arka Pal, Deep Karkhanis, Samuel Dooley, et al.2024 · 82 citations
- Agent Q: Advanced Reasoning and Learning for Autonomous AI AgentsarXiv:2408.07199Pranav Putta, Edmund Mills, Naman Garg, et al.2024 · 68 citations
- Free Process Rewards without Process LabelsarXiv:2412.01981Lifan Yuan, Wendi Li, Huayu Chen, et al.2024 · 58 citations
- Improve Vision Language Model Chain-of-thought ReasoningAnnual Meeting of the Association for Computational Linguistics (ACL)Ruohong Zhang, Bowen Zhang, Yanghao Li, et al.2025 · 42 citations
- Binary Classifier Optimization for Large Language Model AlignmentAnnual Meeting of the Association for Computational Linguistics (ACL)Seungjae Jung, Gunsoo Han, Daniel Wontae Nam, et al.2025 · 26 citations
- Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical ReasoningarXiv:2407.00782Zimu Lu, Aojun Zhou, Ke Wang, et al.2024 · 23 citations
- Online Difficulty Filtering for Reasoning Oriented Reinforcement LearningConference of the European Chapter of the Association for Computational Linguistics (EACL)Sanghwan Bae, Jiwoo Hong, Min Young Lee, et al.2026 · 22 citations
- Weak-to-Strong Search: Align Large Language Models via Searching over Small Language ModelsConference on Neural Information Processing Systems (NeurIPS)Zhanhui Zhou, Zhixuan Liu, Jie Liu, et al.2024 · 17 citations
- Selective Preference Optimization via Token-Level Reward Function EstimationConference on Empirical Methods in Natural Language Processing (EMNLP)Kailai Yang, Zhiwei Liu, Qianqian Xie, et al.2025 · 8 citations
- MuSC: Improving Complex Instruction Following with Multi-granularity Self-Contrastive TrainingAnnual Meeting of the Association for Computational Linguistics (ACL)Hui Huang, Jiaheng Liu, Yancheng He, et al.2025 · 4 citations
- Learning While Staying Curious: Entropy-Preserving Supervised Fine-Tuning via Adaptive Self-Distillation for Large Reasoning ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hao Wang, Hao Gu, Hongming Piao, et al.2026 · 3 citations
This page in Markdown → https://md.research.elamur.ai/free/en/papers/rafailov-2024-r-q-language-model-secretly/cited-by/