Who cites Andrew Lampinen
- SuperGPQA: Scaling LLM Evaluation across 285 Graduate DisciplinesarXiv:2502.14739M-A-P Team, Xinrun Du, Yifan Yao, et al.2025 · 89 citations
- Task Contamination: Language Models May Not Be Few-Shot AnymoreProceedings of the AAAI Conference on Artificial IntelligenceChangmao Li, Jeffrey Flanigan2023 · 89 citations
- Large Language Models as General Pattern MachinesarXiv:2307.04721Suvir Mirchandani, Fei Xia, Pete Florence, et al.2023 · 88 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- Rethinking Interpretability in the Era of Large Language ModelsarXiv:2402.01761Chandan Singh, Jeevana Priya Inala, Michel Galley, et al.2024 · 87 citations
- NL-Augmenter: A Framework for Task-Sensitive Natural Language AugmentationNorthern European Journal of Language TechnologyKaustubh Dhole, Varun Gangal, Sebastian Gehrmann, et al.2023 · 86 citations
- LLMs cannot find reasoning errors, but can correct them given the error locationFindings of the Association for Computational LinguisticsGladys Tyen, Hassan Mansoor, Victor Carbune, et al.2024 · 85 citations
- SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural ReasoningConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Bin Wang, Zhengyuan Liu, Xin Huang, et al.2024 · 85 citations
- ORCA: A Challenging Benchmark for Arabic Language UnderstandingFindings of the Association for Computational LinguisticsAbdelRahim Elmadany, ElMoatez Billah Nagoudi, Muhammad Abdul-Mageed2023 · 83 citations
- Knowledge Fusion of Large Language ModelsarXiv:2401.10491Fanqi Wan, Xinting Huang, Deng Cai, et al.2024 · 82 citations
- Smaug: Fixing Failure Modes of Preference Optimisation with DPO-PositivearXiv:2402.13228Arka Pal, Deep Karkhanis, Samuel Dooley, et al.2024 · 82 citations
- Style Over Substance: Evaluation Biases for Large Language ModelsInternational Conference on Computational Linguistics (COLING)Minghao Wu, Alham Fikri Aji2025 · 81 citations
- AppWorld: A Controllable World of Apps and People for Benchmarking Interactive Coding AgentsAnnual Meeting of the Association for Computational Linguistics (ACL)Harsh Trivedi, Tushar Khot, Mareike Hartmann, et al.2024 · 80 citations
- KoBBQ: Korean Bias Benchmark for Question AnsweringTransactions of the Association for Computational Linguistics (TACL)Jiho Jin, Jiseon Kim, Nayeon Lee, et al.2024 · 78 citations
- KMMLU: Measuring Massive Multitask Language Understanding in KoreanConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guijin Son, Hanwool Lee, Sungdong Kim, et al.2025 · 76 citations
- PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics CapabilitiesSettaluri Sravanthi, Meet Doshi, Pavan Tankala, et al.2024 · 75 citations
- SciCode: A Research Coding Benchmark Curated by ScientistsConference on Neural Information Processing Systems (NeurIPS)Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, et al.2024 · 75 citations
- Harnessing Explanations: LLM-to-LM Interpreter for Enhanced Text-Attributed Graph Representation LearningarXiv:2305.19523Xiaoxin He, Xavier Bresson, Thomas Laurent, et al.2023 · 75 citations
- Training Language Models to Reason EfficientlyConference on Neural Information Processing Systems (NeurIPS)Daman Arora, Andrea Zanette2025 · 74 citations
- INCLUDE: Evaluating Multilingual Language Understanding with Regional KnowledgearXiv:2411.19799Angelika Romanou, Negar Foroutan, Anna Sotnikova, et al.2024 · 74 citations
- MediQ: Question-Asking LLMs and a Benchmark for Reliable Interactive Clinical ReasoningConference on Neural Information Processing Systems (NeurIPS)Shuyue Stella Li, Vidhisha Balachandran, Shangbin Feng, et al.2024 · 74 citations
- MEGAVERSE: Benchmarking Large Language Models Across Languages, Modalities, Models and TasksConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sanchit Ahuja, Divyanshu Aggarwal, Varun Gumma, et al.2024 · 74 citations
- AlignBench: Benchmarking Chinese Alignment of Large Language ModelsarXiv:2311.18743Xiao Liu, Xuanyu Lei, Shengyuan Wang, et al.2023 · 74 citations
- Large Language Models as Analogical ReasonersarXiv:2310.01714Michihiro Yasunaga, Xinyun Chen, Yujia Li, et al.2023 · 74 citations
- Benchmarking Benchmark Leakage in Large Language ModelsarXiv:2404.18824Ruijie Xu, Zengzhi Wang, Run-Ze Fan, et al.2024 · 73 citations
- Reward Design with Language ModelsarXiv:2303.00001Minae Kwon, Sang Michael Xie, Kalesha Bullard, et al.2023 · 73 citations
- Lion: Adversarial Distillation of Proprietary Large Language ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Yuxin Jiang, Chunkit Chan, Mingyang Chen, et al.2023 · 70 citations
- Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language ModelsarXiv:2305.14705Sheng Shen, Le Hou, Yanqi Zhou, et al.2023 · 70 citations
- Self-Alignment for Factuality: Mitigating Hallucinations in LLMs via Self-EvaluationAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoying Zhang, Baolin Peng, Ye Tian, et al.2024 · 69 citations
- A Thorough Examination of Decoding Methods in the Era of LLMsConference on Empirical Methods in Natural Language Processing (EMNLP)Chufan Shi, Haoran Yang, Deng Cai, et al.2024 · 68 citations
- Buffer of Thoughts: Thought-Augmented Reasoning with Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Ling Yang, Zhaochen Yu, Tianjun Zhang, et al.2024 · 67 citations
- C3oT: Generating Shorter Chain-of-Thought without Compromising EffectivenessProceedings of the AAAI Conference on Artificial IntelligenceYu Kang, Xianghui Sun, Liangyu Chen, et al.2024 · 66 citations
- Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language ModelsFindings of the Association for Computational LinguisticsAlfonso Amayuelas, Kyle Wong, Liangming Pan, et al.2024 · 66 citations
- ARB: Advanced Reasoning Benchmark for Large Language ModelsarXiv:2307.13692Tomohiro Sawada, Daniel Paleka, Alexander Havrilla, et al.2023 · 66 citations
- Synthetic Data (Almost) from Scratch: Generalized Instruction Tuning for Language ModelsarXiv:2402.13064Haoran Li, Qingxiu Dong, Zhengyang Tang, et al.2024 · 65 citations
- Goat: Fine-tuned LLaMA Outperforms GPT-4 on Arithmetic TasksarXiv:2305.14201Tiedong Liu, Bryan Kian Hsiang Low2023 · 65 citations
- A Peek into Token Bias: Large Language Models Are Not Yet Genuine ReasonersConference on Empirical Methods in Natural Language Processing (EMNLP)Bowen Jiang, Yangxinyu Xie, Zhuoqun Hao, et al.2024 · 64 citations
- CValues: Measuring the Values of Chinese Large Language Models from Safety to ResponsibilityarXiv:2307.09705Guohai Xu, Jiayi Liu, Ming Yan, et al.2023 · 64 citations
- Leveraging Large Language Models for NLG Evaluation: Advances and ChallengesConference on Empirical Methods in Natural Language Processing (EMNLP)Zhen Li, Xiaohan Xu, Tao Shen, et al.2024 · 63 citations
- Exploring the Benefits of Training Expert Language Models over Instruction TuningarXiv:2302.03202Joel Jang, Seungone Kim, Seonghyeon Ye, et al.2023 · 63 citations
- Large Language Model Routing with Benchmark DatasetsarXiv:2309.15789Tal Shnitzer, Anthony Ou, Mirian Silva, et al.2023 · 63 citations
- LAB-Bench: Measuring Capabilities of Language Models for Biology ResearcharXiv:2407.10362Jon M. Laurent, Joseph D. Janizek, Michael Ruzo, et al.2024 · 62 citations
- Entity Tracking in Language ModelsarXiv:2305.02363Najoung Kim, Sebastian Schuster2023 · 62 citations
- Exploring the Impact of Instruction Data Scaling on Large Language Models: An Empirical Study on Real-World Use CasesarXiv:2303.14742Yunjie Ji, Yong Deng, Yan Gong, et al.2023 · 62 citations
- Rephrase and Respond: Let Large Language Models Ask Better Questions for ThemselvesarXiv:2311.04205Yihe Deng, Weitong Zhang, Zixiang Chen, et al.2023 · 62 citations
- SatLM: Satisfiability-Aided Language Models Using Declarative PromptingConference on Neural Information Processing Systems (NeurIPS)Xi Ye, Qiaochu Chen, Isil Dillig, et al.2023 · 62 citations
- Teaching Large Language Models to Reason with Reinforcement LearningarXiv:2403.04642Alex Havrilla, Yuqing Du, Sharath Chandra Raparthy, et al.2024 · 61 citations
- Large Language Models Are Not Strong Abstract ReasonersarXiv:2305.19555Gael Gendron, Qiming Bao, Michael Witbrock, et al.2023 · 61 citations
- BIG-Bench Extra HardAnnual Meeting of the Association for Computational Linguistics (ACL)Mehran Kazemi, Bahare Fatemi, Hritik Bansal, et al.2025 · 58 citations
- SoftCoT: Soft Chain-of-Thought for Efficient Reasoning with LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Yige Xu, Xu Guo, Zhiwei Zeng, et al.2025 · 58 citations
- Beyond Chinchilla-Optimal: Accounting for Inference in Language Model Scaling LawsarXiv:2401.00448Nikhil Sardana, Jacob Portes, Sasha Doubov, et al.2024 · 57 citations
- SuperCLUE: A Comprehensive Chinese Large Language Model BenchmarkarXiv:2307.15020Liang Xu, Anqi Li, Lei Zhu, et al.2023 · 57 citations
- Teaching Arithmetic to Small TransformersarXiv:2307.03381Nayoung Lee, Kartik Sreenivasan, Jason D. Lee, et al.2023 · 57 citations
- The Art of Saying No: Contextual Noncompliance in Language ModelsConference on Neural Information Processing Systems (NeurIPS)Faeze Brahman, Sachin Kumar, Vidhisha Balachandran, et al.2024 · 56 citations
- Parsel: Algorithmic Reasoning with Language Models by Composing DecompositionsConference on Neural Information Processing Systems (NeurIPS)Eric Zelikman, Qian Huang, Gabriel Poesia, et al.2023 · 56 citations
- A Chain-of-Thought Is as Strong as Its Weakest Link: A Benchmark for Verifiers of Reasoning ChainsAnnual Meeting of the Association for Computational Linguistics (ACL)Alon Jacovi, Yonatan Bitton, Bernd Bohnet, et al.2024 · 54 citations
- CMB: A Comprehensive Medical Benchmark in ChinesearXiv:2308.08833Xidong Wang, Guiming Hardy Chen, Dingjie Song, et al.2023 · 54 citations
- Beyond Accuracy: Evaluating the Reasoning Behavior of Large Language Models — A SurveyarXiv:2404.01869Philipp Mondorf, Barbara Plank2024 · 53 citations
- Can Long-Context Language Models Subsume Retrieval, RAG, SQL, and More?arXiv:2406.13121Jinhyuk Lee, Anthony Chen, Zhuyun Dai, et al.2024 · 53 citations
- RM-Bench: Benchmarking Reward Models of Language Models with Subtlety and StylearXiv:2410.16184Yantao Liu, Zijun Yao, Rui Min, et al.2024 · 53 citations
- Language acquisition: do children and language models follow similar learning stages?arXiv:2306.03586Linnea Evanson, Yair Lakretz, Jean-Rémi King2023 · 53 citations
- The Learnability of In-Context LearningConference on Neural Information Processing Systems (NeurIPS)Noam Wies, Yoav Levine, Amnon Shashua2023 · 53 citations
- On the application of Large Language Models for language teaching and assessment technologyarXiv:2307.08393Andrew Caines, Luca Benedetto, Shiva Taslimipoor, et al.2023 · 51 citations
- Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference FeedbackConference on Neural Information Processing Systems (NeurIPS)Hamish Ivison, Yizhong Wang, Jiacheng Liu, et al.2024 · 50 citations
- The Effectiveness of LLMs as Annotators: A Comparative Overview and Empirical Analysis of Direct RepresentationLanguage Resources and Evaluation Conference (LREC)Maja Pavlovic, Massimo Poesio2024 · 49 citations
- Linguistic ambiguity analysis in ChatGPTarXiv:2302.06426Miguel Ortega-Martin, Oscar Garcia-Sierra, Alfonso Ardoiz, et al.2023 · 48 citations
- Metaphor Understanding Challenge Dataset for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Xiaoyu Tong, Rochelle Choenni, Martha Lewis, et al.2024 · 47 citations
- Language models scale reliably with over-training and on downstream tasksarXiv:2403.08540Samir Yitzhak Gadre, Georgios Smyrnis, Vaishaal Shankar, et al.2024 · 46 citations
- “According to . . . “: Prompting Language Models Improves Quoting from Pre-Training DataConference of the European Chapter of the Association for Computational Linguistics (EACL)Orion Weller, Marc Marone, Nathaniel Weir, et al.2024 · 46 citations
- GLoRe: When, Where, and How to Improve LLM Reasoning via Global and Local RefinementsarXiv:2402.10963Alex Havrilla, Sharath Raparthy, Christoforus Nalmpantis, et al.2024 · 45 citations
- Lost in Translation: Large Language Models in Non-English Content AnalysisarXiv:2306.07377Gabriel Nicholas, Aliya Bhatia2023 · 45 citations
- Understanding Catastrophic Forgetting in Language Models via Implicit InferencearXiv:2309.10105Suhas Kotha, Jacob Mitchell Springer, Aditi Raghunathan2023 · 45 citations
- HyperCLOVA X Technical ReportarXiv:2404.01954Kang Min Yoo, Jaegeun Han, Sookyo In, et al.2024 · 44 citations
- Transcending Scaling Laws with 0.1% Extra ComputearXiv:2210.11399Yi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 42 citations
- Auxiliary task demands mask the capabilities of smaller language modelsarXiv:2404.02418Jennifer Hu, Michael C. Frank2024 · 41 citations
- SALMON: Self-Alignment with Instructable Reward ModelsarXiv:2310.05910Zhiqing Sun, Yikang Shen, Hongxin Zhang, et al.2023 · 41 citations
- A Systematic Survey of Automatic Prompt Optimization TechniquesConference on Empirical Methods in Natural Language Processing (EMNLP)Kiran Ramnath, Kang Zhou, Sheng Guan, et al.2025 · 40 citations
- Observational Scaling Laws and the Predictability of Language Model PerformancearXiv:2405.10938Yangjun Ruan, Chris J. Maddison, Tatsunori Hashimoto2024 · 40 citations
- Aligning Language Models with Preferences through f-divergence MinimizationarXiv:2302.08215Dongyoung Go, Tomasz Korbak, German Kruszewski, et al.2023 · 39 citations
- Introducing v0.5 of the AI Safety Benchmark from MLCommonsarXiv:2404.12241Bertie Vidgen, Adarsh Agrawal, Ahmed M. Ahmed, et al.2024 · 38 citations
- Aligning Large Language Models with Human Preferences through Representation EngineeringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhao Liu, Xiaohua Wang, Muling Wu, et al.2024 · 37 citations
- LAiW: A Chinese Legal Large Language Models BenchmarkInternational Conference on Computational Linguistics (COLING)Yongfu Dai, Duanyu Feng, Jimin Huang, et al.2025 · 35 citations
- Through the Lens of Core Competency: Survey on Evaluation of Large Language ModelsarXiv:2308.07902Ziyu Zhuang, Qiguang Chen, Longxuan Ma, et al.2023 · 35 citations
- Chinese SimpleQA: A Chinese Factuality Evaluation for Large Language ModelsarXiv:2411.07140Yancheng He, Shilong Li, Jiaheng Liu, et al.2024 · 34 citations
- M3KE: A Massive Multi-Level Multi-Subject Knowledge Evaluation Benchmark for Chinese Large Language ModelsarXiv:2305.10263Chuang Liu, Renren Jin, Yuqi Ren, et al.2023 · 34 citations
- Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge EvaluationarXiv:2306.05783Zhouhong Gu, Xiaoxuan Zhu, Haoning Ye, et al.2023 · 34 citations
- SafetyPrompts: a Systematic Review of Open Datasets for Evaluating and Improving Large Language Model SafetyarXiv:2404.05399Paul Rottger, Fabio Pernisi, Bertie Vidgen, et al.2024 · 33 citations
- BHASA: A Holistic Southeast Asian Linguistic and Cultural Evaluation Suite for Large Language ModelsarXiv:2309.06085Wei Qi Leong, Jian Gang Ngui, Yosephine Susanto, et al.2023 · 33 citations
- The Life Cycle of Knowledge in Big Language Models: A SurveyarXiv:2303.07616 · Machine Intelligence Research. vol. 21, no. 2, pp. 217-238, 2024Boxi Cao, Hongyu Lin, Xianpei Han, et al.2023 · 31 citations
- Benchmark Self-Evolving: A Multi-Agent Framework for Dynamic LLM EvaluationInternational Conference on Computational Linguistics (COLING)Siyuan Wang, Zhuohan Long, Zhihao Fan, et al.2025 · 30 citations
- Analyzing Chain-of-Thought Prompting in Large Language Models via Gradient-based Feature AttributionsarXiv:2307.13339Skyler Wu, Eric Meng Shen, Charumathi Badrinath, et al.2023 · 30 citations
- The Quantization Model of Neural ScalingarXiv:2303.13506Eric J. Michaud, Ziming Liu, Uzay Girit, et al.2023 · 30 citations
- Reasoning Aware Self-Consistency: Leveraging Reasoning Paths for Efficient LLM SamplingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Guangya Wan, Yuqi Wu, Jie Chen, et al.2025 · 29 citations
- Log Probabilities Are a Reliable Estimate of Semantic Plausibility in Base and Instruction-Tuned Language ModelsarXiv:2403.14859Carina Kauf, Emmanuele Chersoni, Alessandro Lenci, et al.2024 · 29 citations
- One Law, Many Languages: Benchmarking Multilingual Legal Reasoning for Judicial SupportarXiv:2306.09237Ronja Stern, Vishvaksenan Rasiah, Veton Matoshi, et al.2023 · 29 citations
- Are LLMs Better than Reported? Detecting Label Errors and Mitigating Their Effect on Model PerformanceConference on Empirical Methods in Natural Language Processing (EMNLP)Omer Nahum, Nitay Calderon, Orgad Keller, et al.2025 · 27 citations
- The Task Shield: Enforcing Task Alignment to Defend Against Indirect Prompt Injection in LLM AgentsAnnual Meeting of the Association for Computational Linguistics (ACL)Feiran Jia, Tong Wu, Xin Qin, et al.2025 · 27 citations
- Towards the Law of Capacity Gap in Distilling Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chen Zhang, Qiuchi Li, Dawei Song, et al.2025 · 27 citations
- Prediction of Arabic Legal Rulings using Large Language ModelsElectronicsAdel Ammar, Anis Koubaa, Bilel Benjdira, et al.2023 · 27 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/andrew-lampinen/cited-by/page/3/