Who cites «Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling»
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- Kimi K2: Open Agentic IntelligencearXiv:2507.20534Kimi Team, Yifan Bai, Yiping Bao, et al.2025 · 347 citations
- DataComp-LM: In search of the next generation of training sets for language modelsConference on Neural Information Processing Systems (NeurIPS)Jeffrey Li, Alex Fang, Georgios Smyrnis, et al.2024 · 191 citations
- Scaling Synthetic Data Creation with 1,000,000,000 PersonasarXiv:2406.20094Tao Ge, Xin Chan, Xiaoyang Wang, et al.2024 · 171 citations
- Best Practices and Lessons Learned on Synthetic DataarXiv:2404.07503Ruibo Liu, Jerry Wei, Fangyu Liu, et al.2024 · 119 citations
- Nemotron-4 340B Technical ReportarXiv:2406.11704Nvidia: Bo Adler, Niket Agarwal, Ashwath Aithal, et al.2024 · 107 citations
- C3oT: Generating Shorter Chain-of-Thought without Compromising EffectivenessProceedings of the AAAI Conference on Artificial IntelligenceYu Kang, Xianghui Sun, Liangyu Chen, et al.2024 · 66 citations
- Nemotron-CC: Transforming Common Crawl into a Refined Long-Horizon Pretraining DatasetAnnual Meeting of the Association for Computational Linguistics (ACL)Dan Su, Kezhi Kong, Ying Lin, et al.2025 · 65 citations
- Instruction Pre-Training: Language Models are Supervised Multitask LearnersConference on Empirical Methods in Natural Language Processing (EMNLP)Daixuan Cheng, Yuxian Gu, Shaohan Huang, et al.2024 · 59 citations
- Nemotron-H: A Family of Accurate and Efficient Hybrid Mamba-Transformer ModelsarXiv:2504.03624NVIDIA: Aaron Blakeman, Aarti Basant, Abhinav Khattar, et al.2025 · 38 citations
- Towards Effective and Efficient Continual Pre-training of Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Jie Chen, Zhipeng Chen, Jiapeng Wang, et al.2025 · 29 citations
- Baichuan-M1: Pushing the Medical Capability of Large Language ModelsarXiv:2502.12671Bingning Wang, Haizhou Zhao, Huozhi Zhou, et al.2025 · 24 citations
- CRAFT Your Dataset: Task-Specific Synthetic Dataset Generation Through Corpus Retrieval and AugmentationTransactions of the Association for Computational Linguistics (TACL)Ingo Ziegler, Abdullatif Köksal, Desmond Elliott, et al.2025 · 20 citations
- Alignment at Pre-training! Towards Native Alignment for Arabic LLMsConference on Neural Information Processing Systems (NeurIPS)Juhao Liang, Zhenyang Cai, Jianqing Zhu, et al.2024 · 14 citations
- Language Models can Self-Lengthen to Generate Long TextsarXiv:2410.23933Shanghaoran Quan, Tianyi Tang, Bowen Yu, et al.2024 · 13 citations
- ArabicSense: A Benchmark for Evaluating Commonsense Reasoning in Arabic with Large Language ModelsWorkshop on Arabic Corpus LinguisticsSalima Lamsiyah, Kamyar Zeinalipour, Samir El amrany, et al.2025 · 7 citations
- Analyzing Dialectical Biases in LLMs for Knowledge and Reasoning BenchmarksFindings of the Association for Computational LinguisticsEileen Pan, Anna Seo Gyeong Choi, Maartje Ter Hoeve, et al.2025 · 6 citations
- Arabic Stable LM: Adapting Stable LM 2 1.6B to ArabicarXiv:2412.04277Zaid Alyafeai, Michael Pieler, Hannah Teufel, et al.2024 · 6 citations
- Aleph-Alpha-GermanWeb: Improving German-language LLM pre-training with model-based data curation and synthetic data generationConference of the European Chapter of the Association for Computational Linguistics (EACL)Thomas F Burns, Letitia Parcalabescu, Stephan Waeldchen, et al.2026 · 4 citations
- Writing-RL: Advancing Long-form Writing via Adaptive Curriculum Reinforcement LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Xuanyu Lei, Chenliang Li, Yuning Wu, et al.2026 · 4 citations
- Modeling Annotator Disagreement with Demographic-Aware Experts and Synthetic PerspectivesAnnual Meeting of the Association for Computational Linguistics (ACL)Yinuo Xu, Veronica Derricks, Allison Earl, et al.2026 · 1 citation
- HSS-Synth: Humanities and Social Sciences Data Synthesis for LLMsFindings of the Association for Computational LinguisticsRu Peng, Tianyu Zhao, Xijun Gu, et al.2026
- Large-Scale Diverse Synthesis for Mid-TrainingFindings of the Association for Computational LinguisticsXuemiao Zhang, Chengying Tu, Can Ren, et al.2026
- LinkQA: Synthesizing Diverse QA from Multiple Seeds Strongly Linked by Knowledge PointsAnnual Meeting of the Association for Computational Linguistics (ACL)Xuemiao Zhang, Can Ren, Chengying Tu, et al.2026
- SciPedia: Unlocking the Value of Scientific Data for Pre-trainingAnnual Meeting of the Association for Computational Linguistics (ACL)Yiwei Qin, Zhen Huang, Tiantian Mi, et al.2026
- SELECting over Tokens: Curating Pre-training Data at Scale via Token ClassificationAnnual Meeting of the Association for Computational Linguistics (ACL)Xin Tong, Weidong Zhang, Jiaang Li, et al.2026
- Systematic Evaluation of the Quality of Synthetic Clinical Notes Rephrased by LLMs at Million-Note ScaleBioNLPJinghui Liu, Sarvesh Soni, Anthony Nguyen2026
This page in Markdown → https://md.research.elamur.ai/free/en/papers/maini-2024-rephrasing-web-recipe-compute-data/cited-by/