Who cites Adrian Weller
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsIEEE/CVF International Conference on Computer Vision (ICCV)Ze Liu, Yutong Lin, Yue Cao, et al.2021 · 33,968 citations
- GPT-4 Technical ReportarXiv:2303.08774OpenAI, Josh Achiam, Steven Adler, et al.2023 · 13,036 citations
- The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
- PaLM: Scaling Language Modeling with PathwaysarXiv:2204.02311Aakanksha Chowdhery, Sharan Narang, Jacob Devlin, et al.2022 · 4,753 citations
- A Survey on Evaluation of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyYupeng Chang, Xu Wang, Jindong Wang, et al.2023 · 3,648 citations
- On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
- RoFormer: Enhanced Transformer with Rotary Position EmbeddingarXiv:2104.09864Jianlin Su, Yu Lu, Shengfeng Pan, et al.2021 · 3,028 citations
- DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language ModelsarXiv:2402.03300Zhihong Shao, Peiyi Wang, Qihao Zhu, et al.2024 · 2,115 citations
- Qwen Technical ReportarXiv:2309.16609Jinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,669 citations
- Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
- A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
- FlashAttention-2: Faster Attention with Better Parallelism and Work PartitioningarXiv:2307.08691Tri Dao2023 · 1,240 citations
- OpenAI o1 System CardarXiv:2412.16720OpenAI, Aaron Jaech, Adam Kalai, et al.2024 · 1,110 citations
- Interpretable Machine Learning: Fundamental Principles and 10 Grand ChallengesarXiv:2103.11251 · Statistics Surveys, 2021Cynthia Rudin; Chaofan Chen; Zhi Chen; Haiyang Huang; Lesia Semenova;, Chudi Zhong2021 · 974 citations
- ImageBind: One Embedding Space To Bind Them AllIEEE Computer Society Conference on Computer Vision and Pattern RecognitionRohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, et al.2023 · 954 citations
- s1: Simple test-time scalingConference on Empirical Methods in Natural Language Processing (EMNLP)Niklas Muennighoff, Zitong Yang, Weijia Shi, et al.2025 · 608 citations
- FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
- AudioLM: a Language Modeling Approach to Audio GenerationIEEE/ACM Transactions on Audio Speech and Language ProcessingZalan Borsos, Raphael Marinier, Damien Vincent, et al.2022 · 581 citations
- MetaMath: Bootstrap Your Own Mathematical Questions for Large Language ModelsarXiv:2309.12284Longhui Yu, Weisen Jiang, Han Shi, et al.2023 · 565 citations
- How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source SuitesScience China Information SciencesZhe Chen, Weiyun Wang, Hao Tian, et al.2024 · 541 citations
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelarXiv:2401.09417Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.2024 · 500 citations
- Math-Shepherd: Verify and Reinforce LLMs Step-by-step without Human AnnotationsAnnual Meeting of the Association for Computational Linguistics (ACL)Peiyi Wang, Lei Li, Zhihong Shao, et al.2024 · 497 citations
- Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons LearnedarXiv:2209.07858Deep Ganguli, Liane Lovitt, Jackson Kernion, et al.2022 · 485 citations
- OlympiadBench: A Challenging Benchmark for Promoting AGI with Olympiad-Level Bilingual Multimodal Scientific ProblemsAnnual Meeting of the Association for Computational Linguistics (ACL)Chaoqun He, Renjie Luo, Yuzhuo Bai, et al.2024 · 456 citations
- Long Range Arena: A Benchmark for Efficient TransformersarXiv:2011.04006Yi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 414 citations
- FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precisionConference on Neural Information Processing Systems (NeurIPS)Jay Shah, Ganesh Bikshandi, Ying Zhang, et al.2024 · 400 citations
- LongT5: Efficient Text-To-Text Transformer for Long SequencesFindings of the Association for Computational LinguisticsMandy Guo, Joshua Ainslie, David Uthus, et al.2022 · 399 citations
- WizardMath: Empowering Mathematical Reasoning for Large Language Models via Reinforced Evol-InstructarXiv:2308.09583Haipeng Luo, Qingfeng Sun, Can Xu, et al.2023 · 372 citations
- Efficient Attentions for Long Document SummarizationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Luyang Huang, Shuyang Cao, Nikolaus Parulian, et al.2021 · 336 citations
- Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
- Challenges and Applications of Large Language ModelsarXiv:2307.10169Jean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 301 citations
- Canine: Pre-training an Efficient Tokenization-Free Encoder for Language RepresentationTransactions of the Association for Computational Linguistics (TACL)Jonathan H. Clark, Dan Garrette, Iulia Turc, et al.2022 · 301 citations
- xLSTM: Extended Long Short-Term MemoryConference on Neural Information Processing Systems (NeurIPS)Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.2024 · 296 citations
- MAmmoTH: Building Math Generalist Models through Hybrid Instruction TuningarXiv:2309.05653Xiang Yue, Xingwei Qu, Ge Zhang, et al.2023 · 295 citations
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time ScalingarXiv:2412.05271Zhe Chen, Weiyun Wang, Yue Cao, et al.2024 · 287 citations
- Llemma: An Open Language Model For MathematicsarXiv:2310.10631Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, et al.2023 · 286 citations
- Large Language Models for Mathematical Reasoning: Progresses and ChallengesConference of the European Chapter of the Association for Computational Linguistics (EACL)Janice Ahn, Rishu Verma, Renze Lou, et al.2024 · 280 citations
- Perceiver: General Perception with Iterative AttentionarXiv:2103.03206Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 269 citations
- Predictability and Surprise in Large Generative ModelsACM Conference on Fairness, Accountability, and Transparency (FAccT)Deep Ganguli, Danny Hernandez, Liane Lovitt, et al.2022 · 268 citations
- Transformers learn in-context by gradient descentarXiv:2212.07677Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, et al.2022 · 247 citations
- On LLMs-Driven Synthetic Data Generation, Curation, and Evaluation: A SurveyFindings of the Association for Computational LinguisticsLin Long, Rui Wang, Ruixuan Xiao, et al.2024 · 237 citations
- What matters when building vision-language models?Conference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 212 citations
- LIMO: Less is More for ReasoningarXiv:2502.03387Yixin Ye, Zhen Huang, Yang Xiao, et al.2025 · 209 citations
- AlphaEvolve: A coding agent for scientific and algorithmic discoveryarXiv:2506.13131Alexander Novikov, Ngân Vũ, Marvin Eisenberger, et al.2025 · 202 citations
- ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree SearchConference on Neural Information Processing Systems (NeurIPS)Dan Zhang, Sining Zhoubian, Ziniu Hu, et al.2024 · 200 citations
- Can LLMs Generate Novel Research Ideas? A Large-Scale Human Study with 100+ NLP ResearchersarXiv:2409.04109Chenglei Si, Diyi Yang, Tatsunori Hashimoto2024 · 196 citations
- Charformer: Fast Character Transformers via Gradient-based Subword TokenizationarXiv:2106.12672Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 186 citations
- Adapting Language Models to Compress ContextsConference on Empirical Methods in Natural Language Processing (EMNLP)Alexis Chevalier, Alexander Wettig, Anirudh Ajith, et al.2023 · 182 citations
- Evaluating Large Language Models: A Comprehensive SurveyarXiv:2310.19736Zishan Guo, Renren Jin, Chuang Liu, et al.2023 · 182 citations
- SmolLM2: When Smol Goes Big — Data-Centric Training of a Small Language ModelarXiv:2502.02737Loubna Ben Allal, Anton Lozhkov, Elie Bakouch, et al.2025 · 181 citations
- Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language ModelsScience China Information SciencesQiguang Chen, Libo Qin, Jinhao Liu, et al.2025 · 176 citations
- Scaling Synthetic Data Creation with 1,000,000,000 PersonasarXiv:2406.20094Tao Ge, Xin Chan, Xiaoyang Wang, et al.2024 · 171 citations
- Improve Mathematical Reasoning in Language Models by Automated Process SupervisionarXiv:2406.06592Liangchen Luo, Yinxiao Liu, Rosanne Liu, et al.2024 · 168 citations
- SCROLLS: Standardized CompaRison Over Long Language SequencesConference on Empirical Methods in Natural Language Processing (EMNLP)Uri Shaham, Elad Segal, Maor Ivgi, et al.2022 · 165 citations
- CultureLLM: Incorporating Cultural Differences into Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Cheng Li, Mengzhou Chen, Jindong Wang, et al.2024 · 162 citations
- A Comprehensive Survey of Small Language Models in the Era of Large Language Models: Techniques, Enhancements, Applications, Collaboration with LLMs, and TrustworthinessACM Transactions on Intelligent Systems and TechnologyFali Wang, Zhiwei Zhang, Xianren Zhang, et al.2024 · 159 citations
- Iterative Reasoning Preference OptimizationConference on Neural Information Processing Systems (NeurIPS)Richard Yuanzhe Pang, Weizhe Yuan, Kyunghyun Cho, et al.2024 · 153 citations
- Unsolved Problems in ML SafetyarXiv:2109.13916Dan Hendrycks, Nicholas Carlini, John Schulman, et al.2021 · 151 citations
- rStar-Math: Small LLMs Can Master Math Reasoning with Self-Evolved Deep ThinkingarXiv:2501.04519Xinyu Guan, Li Lyna Zhang, Yifei Liu, et al.2025 · 146 citations
- How Abilities in Large Language Models are Affected by Supervised Fine-tuning Data CompositionAnnual Meeting of the Association for Computational Linguistics (ACL)Guanting Dong, Hongyi Yuan, Keming Lu, et al.2024 · 145 citations
- Efficient Methods for Natural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Marcos Treviso, Ji-Ung Lee, Tianchu Ji, et al.2023 · 145 citations
- JudgeLM: Fine-tuned Large Language Models are Scalable JudgesarXiv:2310.17631Lianghui Zhu, Xinggang Wang, Xinlong Wang2023 · 145 citations
- DeepInception: Hypnotize Large Language Model to Be JailbreakerarXiv:2311.03191Xuan Li, Zhanke Zhou, Jianing Zhu, et al.2023 · 141 citations
- DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal UnderstandingarXiv:2412.10302Zhiyu Wu, Xiaokang Chen, Zizheng Pan, et al.2024 · 137 citations
- ReFT: Reasoning with Reinforced Fine-TuningAnnual Meeting of the Association for Computational Linguistics (ACL)Luong Trung, Xinbo Zhang, Zhanming Jie, et al.2024 · 134 citations
- OpenWebMath: An Open Dataset of High-Quality Mathematical Web TextarXiv:2310.06786Keiran Paster, Marco Dos Santos, Zhangir Azerbayev, et al.2023 · 132 citations
- LM vs LM: Detecting Factual Errors via Cross ExaminationConference on Empirical Methods in Natural Language Processing (EMNLP)Roi Cohen, May Hamri, Mor Geva, et al.2023 · 126 citations
- H2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language ModelsarXiv:2306.14048Zhenyu Zhang, Ying Sheng, Tianyi Zhou, et al.2023 · 124 citations
- Large Language Model Alignment: A SurveyarXiv:2309.15025Tianhao Shen, Renren Jin, Yufei Huang, et al.2023 · 124 citations
- LongNet: Scaling Transformers to 1,000,000,000 TokensarXiv:2307.02486Jiayu Ding, Shuming Ma, Li Dong, et al.2023 · 123 citations
- Inference Scaling Laws: An Empirical Analysis of Compute-Optimal Inference for Problem-Solving with Language ModelsarXiv:2408.00724Yangzhen Wu, Zhiqing Sun, Shanda Li, et al.2024 · 122 citations
- The Alignment Problem from a Deep Learning PerspectivearXiv:2209.00626Richard Ngo, Lawrence Chan, Soren Mindermann2022 · 121 citations
- AlphaMath Almost Zero: Process Supervision without ProcessConference on Neural Information Processing Systems (NeurIPS)Guoxin Chen, Minpeng Liao, Chengxi Li, et al.2024 · 120 citations
- Demystifying Long Chain-of-Thought Reasoning in LLMsarXiv:2502.03373Edward Yeo, Yuxuan Tong, Morry Niu, et al.2025 · 119 citations
- Best Practices and Lessons Learned on Synthetic DataarXiv:2404.07503Ruibo Liu, Jerry Wei, Fangyu Liu, et al.2024 · 119 citations
- SaulLM-7B: A pioneering Large Language Model for LawarXiv:2403.03883Pierre Colombo, Telmo Pessoa Pires, Malik Boudiaf, et al.2024 · 119 citations
- A Length-Extrapolatable TransformerAnnual Meeting of the Association for Computational Linguistics (ACL)Yutao Sun, Li Dong, Barun Patra, et al.2023 · 118 citations
- In-context Autoencoder for Context Compression in a Large Language ModelarXiv:2307.06945Tao Ge, Jing Hu, Lei Wang, et al.2023 · 114 citations
- A Survey on Efficient Inference for Large Language ModelsarXiv:2404.14294Zixuan Zhou, Xuefei Ning, Ke Hong, et al.2024 · 113 citations
- Orca-Math: Unlocking the potential of SLMs in Grade School MatharXiv:2402.14830Arindam Mitra, Hamed Khanpour, Corby Rosset, et al.2024 · 111 citations
- Unlimiformer: Long-Range Transformers with Unlimited Length InputConference on Neural Information Processing Systems (NeurIPS)Amanda Bertsch, Uri Alon, Graham Neubig, et al.2023 · 111 citations
- Linear Transformers Are Secretly Fast Weight ProgrammersarXiv:2102.11174Imanol Schlag, Kazuki Irie, Jurgen Schmidhuber2021 · 111 citations
- Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
- GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem SolversAnnual Meeting of the Association for Computational Linguistics (ACL)Qintong Li, Leyang Cui, Xueliang Zhao, et al.2024 · 108 citations
- Model evaluation for extreme risksarXiv:2305.15324Toby Shevlane, Sebastian Farquhar, Ben Garfinkel, et al.2023 · 104 citations
- MMTEB: Massive Multilingual Text Embedding BenchmarkarXiv:2502.13595Kenneth Enevoldsen, Isaac Chung, Imene Kerboua, et al.2025 · 103 citations
- A Careful Examination of Large Language Model Performance on Grade School ArithmeticConference on Neural Information Processing Systems (NeurIPS)Hugh Zhang, Jeff Da, Dean Lee, et al.2024 · 101 citations
- ToolACE: Winning the Points of LLM Function CallingarXiv:2409.00920Weiwen Liu; Xu Huang; Xingshan Zeng; Xinlong Hao; Shuai Yu; Dexun Li; Shuai Wang; Weinan Gan; Zhengying Liu; Yuanqing Yu; Zezhong Wang; Yuxian Wang; Wu Ning; Yutai Hou; Bin Wang; Chuhan Wu; Xinzhi Wang; Yong Liu; Yasheng Wang; Duyu Tang; Dandan Tu; Lifeng Shang; Xin Jiang; Ruiming Tang; Defu Lian; Qun Liu;, Enhong Chen2024 · 101 citations
- Do Long-Range Language Models Actually Use Long-Range Context?Conference on Empirical Methods in Natural Language Processing (EMNLP)Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke, et al.2021 · 101 citations
- Transformer Quality in Linear TimearXiv:2202.10447Weizhe Hua, Zihang Dai, Hanxiao Liu, et al.2022 · 99 citations
- OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning DatasetConference on Neural Information Processing Systems (NeurIPS)Shubham Toshniwal, Ivan Moshkov, Sean Narenthiran, et al.2024 · 98 citations
- Self-Distilled Reasoner: On-Policy Self-Distillation for Large Language ModelsarXiv:2601.18734Siyan Zhao, Zhihui Xie, Mengchen Liu, et al.2026 · 97 citations
- MAmmoTH2: Scaling Instructions from the WebConference on Neural Information Processing Systems (NeurIPS)Xiang Yue, Tuney Zheng, Ge Zhang, et al.2024 · 96 citations
- SeaLLMs — Large Language Models for Southeast AsiaarXiv:2312.00738Xuan-Phi Nguyen, Wenxuan Zhang, Xin Li, et al.2023 · 92 citations
- InternLM-Math: Open Math Large Language Models Toward Verifiable ReasoningarXiv:2402.06332Huaiyuan Ying, Shuo Zhang, Linyang Li, et al.2024 · 90 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- Not All Experts are Equal: Efficient Expert Pruning and Skipping for Mixture-of-Experts Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Xudong Lu, Qi Liu, Yuhui Xu, et al.2024 · 88 citations
- Landmark Attention: Random-Access Infinite Context Length for TransformersarXiv:2305.16300Amirkeivan Mohtashami, Martin Jaggi2023 · 88 citations
- Foundational Challenges in Assuring Alignment and Safety of Large Language ModelsarXiv:2404.09932Usman Anwar, Abulhair Saparov, Javier Rando, et al.2024 · 87 citations
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language ModelsarXiv:2404.02948Fanxu Meng, Zhaohui Wang, Muhan Zhang2024 · 86 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/adrian-weller/cited-by/