Jipeng Zhang
Jipeng Zhang has 2 papers in our library, in 2023–2024, most of them on Language models & pretraining; often with Hanze Dong, Rui Pan, Shizhe Diao.
OpenAlex · ORCID · h-index 15 · 56 works · 989 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 445 times in our library · 6 more in our library without a page yet · ⭐ Paper Stars ranking: #4093
Affiliations
Concepts, shelves and topics
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Artificial Intelligence · 2 worksArts and Humanities · 2 worksComputer Science · 2 worksLanguage and Linguistics · 2 worksSafety Research · 1 workSocial Sciences · 1 work
🧭 Topics 1Research subjects and languages the work is about.Language models & pretraining · 1 work
Works by year
2020s
Papers
- RAFT: Reward rAnked FineTuning for Generative Foundation Model Alignment (2023 · 239 citations)
Aligning generative foundation models with human preferences usually relies on RLHF with PPO. PPO is unstable and sample-inefficient, and it must keep several large models in memory at once (policy, reference, reward, critic). The authors propose RAFT (Reward rAnked FineTuning), a simpler alternative that repeats… - Mitigating the Alignment Tax of RLHF (2024 · 82 citations)
RLHF makes LLMs follow human preferences, but it also tends to erode skills learned in pre-training. This loss is called the alignment tax. The authors measured it by aligning OpenLLaMA-3B on the Anthropic helpfulness/harmlessness data with Rejection Sampling Fine-tuning (RSF) and DPO. They then tracked performance…
All works
- RAFT: Reward rAnked FineTuning for Generative Foundation Model AlignmentarXiv:2304.06767Hanze Dong, Wei Xiong, Deepanshu Goyal, et al.2023 · 239 citations
- Mitigating the Alignment Tax of RLHFConference on Empirical Methods in Natural Language Processing (EMNLP)Yong Lin, Hangyu Lin, Wei Xiong, et al.2024 · 82 citations
- G-LLaVA: Solving Geometric Problem with Multi-Modal Large Language ModelarXiv:2312.11370 · original ↗ · no summary yetJiahui Gao et al.2023 · 74 citations
- MLLM-Protector: Ensuring MLLM's Safety without Hurting PerformanceProceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · original ↗ · no summary yetRenjie Pi et al.2024 · 57 citations
- TheoremLlama: Transforming General-Purpose LLMs into Lean4 ExpertsarXiv:2407.03203 · original ↗ · no summary yetRuida Wang et al.2024 · 50 citations
- Process-Driven Autoformalization in Lean 4arXiv:2406.01940 · original ↗ · no summary yetJianqiao Lu et al.2024 · 33 citations
- MA-LoT: Model-Collaboration Lean-based Long Chain-of-Thought Reasoning enhances Formal Theorem ProvingarXiv:2503.03205 · original ↗ · no summary yetRuida Wang et al.2025 · 17 citations
- LongVideoAgent: Multi-Agent Reasoning with Long VideosProceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · original ↗ · no summary yetRuntao Liu et al.2026 · 3 citations
Co-authors here
- Hanze Dong ×2
- Rui Pan ×2
- Shizhe Diao ×2
- Wei Xiong ×2
- Hangyu Lin
- Haoxiang Wang
- Kashun Shum
- Tong Zhang
- Yong Lin
Venues
- Conference on Empirical Methods in Natural Language Processing (EMNLP) ×2: EMNLP 2024
- Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jipeng-zhang/