Who cites Kaustubh Dhole
- PyramidInfer: Pyramid KV Cache Compression for High-throughput LLM InferenceFindings of the Association for Computational LinguisticsDongjie Yang, Xiaodong Han, Yan Gao, et al.2024 · 91 citations
- “My Answer is C”: First-Token Probabilities Do Not Match Text Answers in Instruction-Tuned Language ModelsFindings of the Association for Computational LinguisticsXinpeng Wang, Bolei Ma, Chengzhi Hu, et al.2024 · 91 citations
- SciEval: A Multi-Level Large Language Model Evaluation Benchmark for Scientific ResearchProceedings of the AAAI Conference on Artificial IntelligenceLiangtai Sun, Yang Han, Zihan Zhao, et al.2023 · 91 citations
- CVQA: Culturally-diverse Multilingual Visual Question Answering BenchmarkConference on Neural Information Processing Systems (NeurIPS)David Romero, Chenyang Lyu, Haryo Akbarianto Wibowo, et al.2024 · 90 citations
- Rephrasing the Web: A Recipe for Compute and Data-Efficient Language ModelingAnnual Meeting of the Association for Computational Linguistics (ACL)Pratyush Maini, Skyler Seto, Richard Bai, et al.2024 · 90 citations
- SuperGPQA: Scaling LLM Evaluation across 285 Graduate DisciplinesarXiv:2502.14739M-A-P Team, Xinrun Du, Yifan Yao, et al.2025 · 89 citations
- Task Contamination: Language Models May Not Be Few-Shot AnymoreProceedings of the AAAI Conference on Artificial IntelligenceChangmao Li, Jeffrey Flanigan2023 · 89 citations
- Large Language Models as General Pattern MachinesarXiv:2307.04721Suvir Mirchandani, Fei Xia, Pete Florence, et al.2023 · 88 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- NL-Augmenter: A Framework for Task-Sensitive Natural Language AugmentationNorthern European Journal of Language TechnologyKaustubh Dhole, Varun Gangal, Sebastian Gehrmann, et al.2023 · 86 citations
- Multi-lingual Evaluation of Code Generation ModelsarXiv:2210.14868Ben Athiwaratkun, Sanjay Krishna Gouda, Zijian Wang, et al.2022 · 86 citations
- LLMs cannot find reasoning errors, but can correct them given the error locationFindings of the Association for Computational LinguisticsGladys Tyen, Hassan Mansoor, Victor Carbune, et al.2024 · 85 citations
- SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural ReasoningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Zhengyuan Liu, Xin Huang, et al.2024 · 85 citations
- AlexaTM 20B: Few-Shot Learning Using a Large-Scale Multilingual Seq2Seq ModelarXiv:2208.01448Saleh Soltan, Shankar Ananthakrishnan, Jack FitzGerald, et al.2022 · 84 citations
- ORCA: A Challenging Benchmark for Arabic Language UnderstandingFindings of the Association for Computational LinguisticsAbdelRahim Elmadany, ElMoatez Billah Nagoudi, Muhammad Abdul-Mageed2023 · 83 citations
- LLMs Get Lost In Multi-Turn ConversationarXiv:2505.06120Philippe Laban, Hiroaki Hayashi, Yingbo Zhou, et al.2025 · 82 citations
- Knowledge Fusion of Large Language ModelsarXiv:2401.10491Fanqi Wan, Xinting Huang, Deng Cai, et al.2024 · 82 citations
- Smaug: Fixing Failure Modes of Preference Optimisation with DPO-PositivearXiv:2402.13228Arka Pal, Deep Karkhanis, Samuel Dooley, et al.2024 · 82 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language ReasoningConference on Neural Information Processing Systems (NeurIPS)Wei Fu, Jiaxuan Gao, Xujie Shen, et al.2025 · 80 citations
- AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding AgentsAnnual Meeting of the Association for Computational Linguistics (ACL)Harsh Trivedi, Tushar Khot, Mareike Hartmann, et al.2024 · 80 citations
- A Survey on Test-Time Scaling in Large Language Models: What, How, Where, and How Well?arXiv:2503.24235Qiyuan Zhang, Fuyuan Lyu, Zexu Sun, et al.2025 · 79 citations
- KoBBQ: Korean Bias Benchmark for Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Jiho Jin, Jiseon Kim, Nayeon Lee, et al.2024 · 78 citations
- KMMLU: Measuring Massive Multitask Language Understanding in KoreanConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guijin Son, Hanwool Lee, Sungdong Kim, et al.2025 · 76 citations
- MMLU-ProX: A Multilingual Benchmark for Advanced Large Language Model EvaluationConference on Empirical Methods in Natural Language Processing (EMNLP)Weihao Xuan, Rui Yang, Heli Qi, et al.2025 · 75 citations
- Multilingual Large Language Model: A Survey of Resources, Taxonomy and FrontiersarXiv:2404.04925Libo Qin, Qiguang Chen, Yuhang Zhou, et al.2024 · 75 citations
- PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics CapabilitiesSettaluri Sravanthi, Meet Doshi, Pavan Tankala, et al.2024 · 75 citations
- SciCode: A Research Coding Benchmark Curated by ScientistsConference on Neural Information Processing Systems (NeurIPS)Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, et al.2024 · 75 citations
- Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation LearningarXiv:2305.19523Xiaoxin He, Xavier Bresson, Thomas Laurent, et al.2023 · 75 citations
- Training Language Models to Reason EfficientlyConference on Neural Information Processing Systems (NeurIPS)Daman Arora, Andrea Zanette2025 · 74 citations
- INCLUDE: Evaluating Multilingual Language Understanding with Regional KnowledgearXiv:2411.19799Angelika Romanou, Negar Foroutan, Anna Sotnikova, et al.2024 · 74 citations
- MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical ReasoningConference on Neural Information Processing Systems (NeurIPS)Shuyue Stella Li, Vidhisha Balachandran, Shangbin Feng, et al.2024 · 74 citations
- MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, et al.2024 · 74 citations
- AlignBench: Benchmarking Chinese Alignment of Large Language ModelsarXiv:2311.18743Xiao Liu, Xuanyu Lei, Shengyuan Wang, et al.2023 · 74 citations
- Large Language Models as Analogical ReasonersarXiv:2310.01714Michihiro Yasunaga, Xinyun Chen, Yujia Li, et al.2023 · 74 citations
- Benchmarking Benchmark Leakage in Large Language ModelsarXiv:2404.18824Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.2024 · 73 citations
- WebThinker: Empowering Large Reasoning Models with Deep Research CapabilityConference on Neural Information Processing Systems (NeurIPS)Xiaoxi Li, Jiajie Jin, Guanting Dong, et al.2025 · 72 citations
- Lion: Adversarial Distillation of Proprietary Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxin Jiang, Chunkit Chan, Mingyang Chen, et al.2023 · 70 citations
- Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language ModelsarXiv:2305.14705Sheng Shen, Le Hou, Yanqi Zhou, et al.2023 · 70 citations
- Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoying Zhang, Baolin Peng, Ye Tian, et al.2024 · 69 citations
- AraDiCE: Benchmarks for Dialectal and Cultural Capabilities in LLMsInternational Conference on Computational Linguistics (COLING)Basel Mousi, Nadir Durrani, Fatema Ahmad, et al.2025 · 68 citations
- A Thorough Examination of Decoding Methods in the Era of LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Chufan Shi, Haoran Yang, Deng Cai, et al.2024 · 68 citations
- Preventing Generation of Verbatim Memorization in Language Models Gives a False Sense of PrivacyInternational Natural Language Generation Conference (INLG)Daphne Ippolito, Florian Tramer, Milad Nasr, et al.2023 · 68 citations
- Buffer of Thoughts: Thought-Augmented Reasoning with Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Ling Yang, Zhaochen Yu, Tianjun Zhang, et al.2024 · 67 citations
- Kimi K2.5: Visual Agentic IntelligencearXiv:2602.02276Kimi Team, Tongtong Bai, Yifan Bai, et al.2026 · 66 citations
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
- Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language ModelsFindings of the Association for Computational LinguisticsAlfonso Amayuelas, Kyle Wong, Liangming Pan, et al.2024 · 66 citations
- ARB: Advanced Reasoning Benchmark for Large Language ModelsarXiv:2307.13692Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, et al.2023 · 66 citations
- MedXpertQA: Benchmarking Expert-Level Medical Reasoning and UnderstandingarXiv:2501.18362Yuxin Zuo, Shang Qu, Yifei Li, et al.2025 · 65 citations
- Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language ModelsarXiv:2402.13064Haoran Li, Qingxiu Dong, Zhengyang Tang, et al.2024 · 65 citations
- Goat: Fine-tuned LLaMA Outperforms GPT-4 on Arithmetic TasksarXiv:2305.14201Tiedong Liu, Bryan Kian Hsiang Low2023 · 65 citations
- A Peek into Token Bias: Large Language Models Are Not Yet Genuine ReasonersConference on Empirical Methods in Natural Language Processing (EMNLP)Bowen Jiang, Yangxinyu Xie, Zhuoqun Hao, et al.2024 · 64 citations
- CValues: Measuring the Values of Chinese Large Language Models from Safety to ResponsibilityarXiv:2307.09705Guohai Xu, Jiayi Liu, Ming Yan, et al.2023 · 64 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Exploring the Benefits of Training Expert Language Models over Instruction TuningarXiv:2302.03202Joel Jang, Seungone Kim, Seonghyeon Ye, et al.2023 · 63 citations
- Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
- LAB-Bench: Measuring Capabilities of Language Models for Biology ResearcharXiv:2407.10362Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, et al.2024 · 62 citations
- Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
- Rephrase and Respond: Let Large Language Models Ask Better Questions for ThemselvesarXiv:2311.04205Yihe Deng, Weitong Zhang, Zixiang Chen, et al.2023 · 62 citations
- SatLM: Satisfiability-Aided Language Models Using Declarative PromptingConference on Neural Information Processing Systems (NeurIPS)Xi Ye, Qiaochu Chen, Isil Dillig, et al.2023 · 62 citations
- Teaching Large Language Models to Reason with Reinforcement LearningarXiv:2403.04642Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, et al.2024 · 61 citations
- Large Language Models Are Not Strong Abstract ReasonersarXiv:2305.19555Gael Gendron, Qiming Bao, Michael Witbrock, et al.2023 · 61 citations
- MiMo-V2-Flash Technical ReportarXiv:2601.02780Xiaomi LLM-Core Team; Bangjun Xiao; Bingquan Xia; Bo Yang; Bofei Gao; Bowen Shen; Chen Zhang; Chenhong He; Chiheng Lou; Fuli Luo; Gang Wang; Gang Xie; Hailin Zhang; Hanglong Lv; Hanyu Li; Heyu Chen; Hongshen Xu; Houbin Zhang; Huaqiu Liu; Jiangshan Duo; Jianyu Wei; Jiebao Xiao; Jinhao Dong; Jun Shi; Junhao Hu; Kainan Bao; Kang Zhou; Lei Li; Liang Zhao; Linghao Zhang; Peidian Li; Qianli Chen; Shaohui Liu; Shihua Yu; Shijie Cao; Shimao Chen; Shouqiu Yu; Shuo Liu; Tianling Zhou; Weijiang Su; Weikun Wang; Wenhan Ma; Xiangwei Deng; Bohan Mao; Bowen Ye; Can Cai; Chenghua Wang; Chengxuan Zhu; Chong Ma; Chun Chen; Chunan Li; Dawei Zhu; Deshan Xiao; Dong Zhang; Duo Zhang; Fangyue Liu; Feiyu Yang; Fengyuan Shi; Guoan Wang; Hao Tian; Hao Wu; Heng Qu; Hongfei Yi; Hongxu An; Hongyi Guan; Xing Zhang; Yifan Song; Yihan Yan; Yihao Zhao; Yingchun Lai; Yizhao Gao; Yu Cheng; Yuanyuan Tian; Yudong Wang; Zhen Tang; Zhengju Tang; Zhengtao Wen; Zhichao Song; Zhixian Zheng; Zihan Jiang; Jian Wen; Jiarui Sun; Jiawei Li; Jinlong Xue; Jun Xia; Kai Fang; Menghang Zhu; Nuo Chen; Qian Tu; Qihao Zhang; Qiying Wang; Rang Li; Rui Ma; Shaolei Zhang; Shengfan Wang; Shicheng Li; Shuhao Gu; Shuhuai Ren; Sirui Deng; Tao Guo; Tianyang Lu; Weiji Zhuang; Weikang Zhang; Weimin Xiong; Wenshan Huang; Wenyu Yang; Xin Zhang; Xing Yong; Xu Wang; Xueyang Xie; Yilin Jiang; Yixin Yang; Yongzhe He; Yu Tu; Yuanliang Dong; Yuchen Liu; Yue Ma; Yue Yu; Yuxing Xiang; Zhaojun Huang; Zhenru Lin; Zhipeng Xu; Zhiyang Chen; Zhonghua Deng; Zihan Zhang;, Zihao Yue2026 · 60 citations
- BIG-Bench Extra HardAnnual Meeting of the Association for Computational Linguistics (ACL)Mehran Kazemi, Bahare Fatemi, Hritik Bansal, et al.2025 · 58 citations
- SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yige Xu, Xu Guo, Zhiwei Zeng, et al.2025 · 58 citations
- Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling LawsarXiv:2401.00448Nikhil Sardana, Jacob Portes, Sasha Doubov, et al.2024 · 57 citations
- SuperCLUE: A Comprehensive Chinese Large Language Model BenchmarkarXiv:2307.15020Liang Xu, Anqi Li, Lei Zhu, et al.2023 · 57 citations
- Teaching Arithmetic to Small TransformersarXiv:2307.03381Nayoung Lee, Kartik Sreenivasan, Jason D. Lee, et al.2023 · 57 citations
- The Art of Saying No: Contextual Noncompliance in Language ModelsConference on Neural Information Processing Systems (NeurIPS)Faeze Brahman, Sachin Kumar, Vidhisha Balachandran, et al.2024 · 56 citations
- A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning ChainsAnnual Meeting of the Association for Computational Linguistics (ACL)Alon Jacovi, Yonatan Bitton, Bernd Bohnet, et al.2024 · 54 citations
- SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian LanguagesConference on Empirical Methods in Natural Language Processing (EMNLP)Holy Lovenia, Rahmad Mahendra, Salsabil Maulana Akbar, et al.2024 · 54 citations
- CMB: A Comprehensive Medical Benchmark in ChinesearXiv:2308.08833Xidong Wang, Guiming Hardy Chen, Dingjie Song, et al.2023 · 54 citations
- Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?arXiv:2406.13121Jinhyuk Lee, Anthony Chen, Zhuyun Dai, et al.2024 · 53 citations
- RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and StylearXiv:2410.16184Yantao Liu, Zijun Yao, Rui Min, et al.2024 · 53 citations
- Language acquisition: do children and language models follow similar learning stages?arXiv:2306.03586Linnea Evanson, Yair Lakretz, Jean-Rémi King2023 · 53 citations
- On the application of Large Language Models for language teaching and assessment technologyarXiv:2307.08393Andrew Caines, Luca Benedetto, Shiva Taslimipoor, et al.2023 · 51 citations
- WebDancer: Towards Autonomous Information Seeking AgencyConference on Neural Information Processing Systems (NeurIPS)Jialong Wu, Baixuan Li, Runnan Fang, et al.2025 · 50 citations
- Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference FeedbackConference on Neural Information Processing Systems (NeurIPS)Hamish Ivison, Yizhong Wang, Jiacheng Liu, et al.2024 · 50 citations
- The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct RepresentationLanguage Resources and Evaluation Conference (LREC)Maja Pavlovic, Massimo Poesio2024 · 49 citations
- Linguistic ambiguity analysis in ChatGPTarXiv:2302.06426Miguel Ortega-Martin, Oscar Garcia-Sierra, Alfonso Ardoiz, et al.2023 · 48 citations
- Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian LanguagesarXiv:2303.13592Zheng-Xin Yong, Ruochen Zhang, Jessica Zosa Forde, et al.2023 · 48 citations
- Metaphor Understanding Challenge Dataset for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Tong, Rochelle Choenni, Martha Lewis, et al.2024 · 47 citations
- Weisfeiler-Leman in the Bamboo: Novel AMR Graph Metrics and a Benchmark for AMR Graph SimilarityJuri Opitz, Angel Daza, Anette Frank2021 · 47 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training DataConference of the European Chapter of the Association for Computational Linguistics (EACL)Orion Weller, Marc Marone, Nathaniel Weir, et al.2024 · 46 citations
- Agentic Reasoning: A Streamlined Framework for Enhancing LLM Reasoning with Agentic ToolsAnnual Meeting of the Association for Computational Linguistics (ACL)Junde Wu, Jiayuan Zhu, Yuyuan Liu, et al.2025 · 45 citations
- GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local RefinementsarXiv:2402.10963Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, et al.2024 · 45 citations
- Lost in Translation: Large Language Models in Non-English Content AnalysisarXiv:2306.07377Gabriel Nicholas, Aliya Bhatia2023 · 45 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- Transcending Scaling Laws with 0.1% Extra ComputearXiv:2210.11399Yi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 42 citations
- DeepResearch Bench: A Comprehensive Benchmark for Deep Research AgentsarXiv:2506.11763Mingxuan Du, Benfeng Xu, Chiwei Zhu, et al.2025 · 41 citations
- Auxiliary task demands mask the capabilities of smaller language modelsarXiv:2404.02418Jennifer Hu, Michael C. Frank2024 · 41 citations
- SALMON: Self-Alignment with Instructable Reward ModelsarXiv:2310.05910Zhiqing Sun, Yikang Shen, Hongxin Zhang, et al.2023 · 41 citations
- SLING: Sino Linguistic Evaluation of Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Yixiao Song, Kalpesh Krishna, Rajesh Bhatt, et al.2022 · 41 citations
- Kimi K3: Open Frontier IntelligencearXiv:2607.24653Kimi Team, Tongtong Bai, Yifan Bai, et al.2026 · 40 citations
- A Systematic Survey of Automatic Prompt Optimization TechniquesConference on Empirical Methods in Natural Language Processing (EMNLP)Kiran Ramnath, Kang Zhou, Sheng Guan, et al.2025 · 40 citations
- Towards Robust Mathematical ReasoningConference on Empirical Methods in Natural Language Processing (EMNLP)Thang Luong, Dawsen Hwang, Hoang H Nguyen, et al.2025 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- NVIDIA Nemotron Nano 2: An Accurate and Efficient Hybrid Mamba-Transformer Reasoning ModelarXiv:2508.14444NVIDIA: Aarti Basant, Abhijit Khairnar, Abhijit Paithankar, et al.2025 · 39 citations
- Unveiling Linguistic Regions in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhihao Zhang, Jun Zhao, Qi Zhang, et al.2024 · 39 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/kaustubh-dhole/cited-by/page/3/