Elamur Research⌕
☰
home / papers / OPT: Open Pre-trained Transformer Language Models / cited by

Who cites «OPT: Open Pre-trained Transformer Language Models»

1,709 papers of our library cite it (of the 140,884 whose bibliographies we read) · 160 with a page here, the most cited first · page 1 of 2 · 1–100 · ← the paper

1 2

  1. LLaMA: Open and Efficient Foundation Language ModelsHugo Touvron, Thibaut Lavril, Gautier Izacard, et al.2023 · 5,609 citations
  2. Large Language Models Encode Clinical KnowledgeKaran Singhal, Shekoofeh Azizi, Tao Tu, et al.2022 · 4,464 citations
  3. Large language models are zero-shot reasonersTakeshi Kojima, Shixiang Shane Gu, Machel Reid, et al.2022 · 3,780 citations
  4. A Survey on Evaluation of Large Language ModelsYupeng Chang, Xu Wang, Jindong Wang, et al.2023 · 3,640 citations
  5. A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open QuestionsLei Huang, Weijiang Yu, Weitao Ma, et al.2023 · 3,221 citations
  6. A Survey of Large Language ModelsWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,847 citations
  7. Visual Instruction TuningHaotian Liu, Chunyuan Li, Qingyang Wu, et al.2023 · 2,487 citations
  8. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsJunnan Li, Dongxu Li, Silvio Savarese, et al.2023 · 2,114 citations
  9. Toolformer: Language Models Can Teach Themselves to Use ToolsTimo Schick, Jane Dwivedi-Yu, Roberto Dessì, et al.2023 · 2,020 citations
  10. Qwen Technical ReportJinze Bai, Shuai Bai, Yunfei Chu, et al.2023 · 1,643 citations
  11. Code Llama: Open Foundation Models for CodeBaptiste Rozière, Jonas Gehring, Fabian Gloeckle, et al.2024 · 1,399 citations
  12. A Comprehensive Overview of Large Language ModelsHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,286 citations
  13. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsDeyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,105 citations
  14. Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic CapabilitiesGheorghe Comanici, Eric Bieber, Mike Schaekermann, et al.2025 · 906 citations
  15. Harnessing the Power of LLMs in Practice: A Survey on ChatGPT and BeyondJingfeng Yang, Hongye Jin, Ruixiang Tang, et al.2023 · 806 citations
  16. Explainability for Large Language Models: A SurveyHaiyan Zhao, Hanjie Chen, Fan Yang, et al.2023 · 785 citations
  17. Towards Reasoning in Large Language Models: A SurveyJie Huang, Kevin Chen-Chuan Chang2023 · 775 citations
  18. GLM-130B: An Open Bilingual Pre-trained ModelAohan Zeng, Xiao Liu, Zhengxiao Du, et al.2022 · 775 citations
  19. HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FaceYongliang Shen, Kaitao Song, Xu Tan, et al.2023 · 737 citations
  20. Crosslingual Generalization through Multitask FinetuningNiklas Muennighoff, Thomas Wang, Lintang Sutawika, et al.2022 · 692 citations
  21. CAMEL: Communicative Agents for "Mind" Exploration of Large Language Model SocietyGuohao Li, Hasan Abed Al Kader Hammoud, Hani Itani, et al.2023 · 689 citations
  22. ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All ToolsTeam GLM, Aohan Zeng, Bin Xu, et al.2024 · 687 citations
  23. Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model SizesCheng-Yu Hsieh, Chun-Liang Li, Chih-kuan Yeh, et al.2023 · 684 citations
  24. Large Language Models Are Human-Level Prompt EngineersYongchao Zhou, Andrei Ioan Muresanu, Ziwen Han, et al.2022 · 677 citations
  25. Instruction Tuning with GPT-4Baolin Peng, Chunyuan Li, Pengcheng He, et al.2023 · 651 citations
  26. Video-ChatGPT: Towards Detailed Video Understanding via Large Vision and Language ModelsMuhammad Maaz, Hanoona Rasheed, Salman Khan, et al.2023 · 634 citations
  27. BloombergGPT: A Large Language Model for FinanceShijie Wu, Ozan Irsoy, Steven Lu, et al.2023 · 608 citations
  28. The Flan Collection: Designing Data and Methods for Effective Instruction TuningShayne Longpre, Le Hou, Tu Vu, et al.2023 · 590 citations
  29. AGIEval: A Human-Centric Benchmark for Evaluating Foundation ModelsWanjun Zhong, Ruixiang Cui, Yiduo Guo, et al.2024 · 563 citations
  30. Gorilla: Large Language Model Connected with Massive APIsShishir G. Patil, Tianjun Zhang, Xin Wang, et al.2023 · 527 citations
  31. Instruction Tuning for Large Language Models: A SurveyShengyu Zhang, Linfeng Dong, Xiaoya Li, et al.2023 · 515 citations
  32. Baichuan 2: Open Large-scale Language ModelsAiyuan Yang, Bin Xiao, Bingning Wang, et al.2023 · 512 citations
  33. Multilingual Machine Translation with Large Language Models: Empirical Results and AnalysisWenhao Zhu, Hongyi Liu, Qingxiu Dong, et al.2024 · 503 citations
  34. REPLUG: Retrieval-Augmented Black-Box Language ModelsWeijia Shi, Sewon Min, Michihiro Yasunaga, et al.2023 · 482 citations
  35. DetectGPT: Zero-Shot Machine-Generated Text Detection using Probability CurvatureEric Mitchell, Yoonho Lee, Alexander Khazatsky, et al.2023 · 474 citations
  36. CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Benchmarking on HumanEval-XQinkai Zheng, Xiao Xia, Xu Zou, et al.2023 · 462 citations
  37. Large language models are few-shot clinical information extractorsMonica Agrawal, Stefan Hegselmann, Hunter Lang, et al.2022 · 448 citations
  38. The Falcon Series of Open Language ModelsEbtesam Almazrouei, Hamza Alobeidli, Abdulaziz Alshamsi, et al.2023 · 436 citations
  39. The Internal State of an LLM Knows When It's LyingAmos Azaria, Tom Mitchell2023 · 425 citations
  40. Security and Privacy Challenges of Large Language Models: A SurveyBadhan Chandra Das, M. Hadi Amini, Yanzhao Wu2024 · 422 citations
  41. Diffusion-LM Improves Controllable Text GenerationXiang Lisa Li, John Thickstun, Ishaan Gulrajani, et al.2022 · 421 citations
  42. Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLsJinyang Li, Binyuan Hui, Ge Qu, et al.2023 · 419 citations
  43. ChatGPT Beyond English: Towards a Comprehensive Evaluation of Large Language Models in Multilingual LearningViet Dac Lai, Nghia Ngo, Amir Pouran Ben Veyseh, et al.2023 · 418 citations
  44. mPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityQinghao Ye, Haiyang Xu, Guohai Xu, et al.2023 · 410 citations
  45. AgentBench: Evaluating LLMs as AgentsXiao Liu, Hao Yu, Hanchen Zhang, et al.2023 · 404 citations
  46. FlexGen: High-Throughput Generative Inference of Large Language Models with a Single GPUYing Sheng, Lianmin Zheng, Binhang Yuan, et al.2023 · 399 citations
  47. CMMLU: Measuring massive multitask language understanding in ChineseHaonan Li, Yixuan Zhang, Fajri Koto, et al.2023 · 384 citations
  48. A Survey on Model Compression for Large Language ModelsXunyu Zhu, Jian Li, Yong Liu, et al.2024 · 381 citations
  49. LegalBench: A Collaboratively Built Benchmark for Measuring Legal Reasoning in Large Language ModelsNeel Guha; Julian Nyarko; Daniel E. Ho; Christopher Re; Adam Chilton; Aditya Narayana; Alex Chohlas-Wood; Austin Peters; Brandon Waldon; Daniel N. Rockmore; Diego Zambrano; Dmitry Talisman; Enam Hoque; Faiz Surani; Frank Fagan; Galit Sarfaty; Gregory M. Dickinson; Haggai Porat; Jason Hegland; Jessica Wu; Joe Nudell; Joel Niklaus; John Nay; Jonathan H. Choi; Kevin Tobia; Margaret Hagan; Megan Ma; Michael Livermore; Nikon Rasumov-Rahe; Nils Holzenberger; Noam Kolt; Peter Henderson; Sean Rehaag; Sharad Goel; Shang Gao; Spencer Williams; Sunny Gandhi; Tom Zur; Varun Iyer;, Zehua Li2023 · 379 citations
  50. VILA: On Pre-training for Visual Language ModelsJi Lin, Hongxu Yin, Wei Ping, et al.2023 · 367 citations
  51. Check Your Facts and Try Again: Improving Large Language Models with External Knowledge and Automated FeedbackBaolin Peng, Michel Galley, Pengcheng He, et al.2023 · 354 citations
  52. VideoChat: Chat-Centric Video UnderstandingKunChang Li, Yinan He, Yi Wang, et al.2023 · 351 citations
  53. TinyLlama: An Open-Source Small Language ModelPeiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.2024 · 350 citations
  54. MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesWeihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 328 citations
  55. LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init AttentionRenrui Zhang, Jiaming Han, Chris Liu, et al.2023 · 322 citations
  56. How Far Can Camels Go? Exploring the State of Instruction Tuning on Open ResourcesYizhong Wang, Hamish Ivison, Pradeep Dasigi, et al.2023 · 304 citations
  57. Paraphrasing evades detectors of AI-generated text, but retrieval is an effective defenseKalpesh Krishna, Yixiao Song, Marzena Karpinska, et al.2023 · 304 citations
  58. AugGPT: Leveraging ChatGPT for Text Data AugmentationHaixing Dai; Zhengliang Liu; Wenxiong Liao; Xiaoke Huang; Yihan Cao; Zihao Wu; Lin Zhao; Shaochen Xu; Wei Liu; Ninghao Liu; Sheng Li; Dajiang Zhu; Hongmin Cai; Lichao Sun; Quanzheng Li; Dinggang Shen; Tianming Liu;, Xiang Li2023 · 302 citations
  59. Can AI-Generated Text be Reliably Detected?Vinu Sankar Sadasivan, Aounon Kumar, Sriram Balasubramanian, et al.2023 · 301 citations
  60. Challenges and Applications of Large Language ModelsJean Kaddour, Joshua Harris, Maximilian Mozes, et al.2023 · 300 citations
  61. OCRBench: On the Hidden Mystery of OCR in Large Multimodal ModelsYuliang Liu, Zhang Li, Mingxin Huang, et al.2023 · 297 citations
  62. Prompting Large Language Model for Machine Translation: A Case StudyBiao Zhang, Barry Haddow, Alexandra Birch2023 · 293 citations
  63. Text Classification via Large Language ModelsXiaofei Sun, Xiaoya Li, Jiwei Li, et al.2023 · 292 citations
  64. MAmmoTH: Building Math Generalist Models through Hybrid Instruction TuningXiang Yue, Xingwei Qu, Ge Zhang, et al.2023 · 288 citations
  65. Generate rather than Retrieve: Large Language Models are Strong Context GeneratorsWenhao Yu, Dan Iter, Shuohang Wang, et al.2022 · 280 citations
  66. LLM-QAT: Data-Free Quantization Aware Training for Large Language ModelsZechun Liu, Barlas Oguz, Changsheng Zhao, et al.2024 · 275 citations
  67. Medusa: Simple LLM Inference Acceleration Framework with Multiple Decoding HeadsTianle Cai, Yuhong Li, Zhengyang Geng, et al.2024 · 271 citations
  68. The Curse of Recursion: Training on Generated Data Makes Models ForgetIlia Shumailov, Zakhar Shumaylov, Yiren Zhao, et al.2023 · 250 citations
  69. Hallucinations in Large Multilingual Translation ModelsNuno M. Guerreiro, Duarte M. Alves, Jonas Waldendorf, et al.2023 · 244 citations
  70. Ignore Previous Prompt: Attack Techniques For Language ModelsFabio Perez, Ian Ribeiro2022 · 244 citations
  71. ZeroGen: Efficient Zero-shot Learning via Dataset GenerationJiacheng Ye, Jiahui Gao, Qintong Li, et al.2022 · 242 citations
  72. Trusting Your Evidence: Hallucinate Less with Context-aware DecodingWeijia Shi, Xiaochuang Han, Mike Lewis, et al.2024 · 240 citations
  73. OPT-IML: Scaling Language Model Instruction Meta Learning through the Lens of GeneralizationSrinivasan Iyer, Xi Victoria Lin, Ramakanth Pasunuru, et al.2022 · 237 citations
  74. Marked Personas: Using Natural Language Prompts to Measure Stereotypes in Language ModelsMyra Cheng, Esin Durmus, Dan Jurafsky2023 · 236 citations
  75. BlenderBot 3: a deployed conversational agent that continually learns to responsibly engageKurt Shuster, Jing Xu, Mojtaba Komeili, et al.2022 · 234 citations
  76. Evaluating Open-Domain Question Answering in the Era of Large Language ModelsEhsan Kamalloo, Nouha Dziri, Charles Clarke, et al.2023 · 233 citations
  77. Principle-Driven Self-Alignment of Language Models from Scratch with Minimal Human SupervisionZhiqing Sun, Yikang Shen, Qinhong Zhou, et al.2023 · 232 citations
  78. What learning algorithm is in-context learning? Investigations with linear modelsEkin Akyürek, Dale Schuurmans, Jacob Andreas, et al.2022 · 224 citations
  79. Steering Language Models With Activation EngineeringAlexander Matt Turner, Lisa Thiergart, Gavin Leech, et al.2023 · 220 citations
  80. Trustworthy LLMs: a Survey and Guideline for Evaluating Large Language Models' AlignmentYang Liu; Yuanshun Yao; Jean-Francois Ton; Xiaoying Zhang; Ruocheng Guo; Hao Cheng; Yegor Klochkov; Muhammad Faaiz Taufiq;, Hang Li2023 · 219 citations
  81. Jais and Jais-chat: Arabic-Centric Foundation and Instruction-Tuned Open Generative Large Language ModelsNeha Sengupta, Sunil Kumar Sahu, Bokang Jia, et al.2023 · 217 citations
  82. Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video UnderstandingHang Zhang, Xin Li, Lidong Bing2023 · 217 citations
  83. Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?Byung-Doh Oh, William Schuler2023 · 211 citations
  84. PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about ChangeKarthik Valmeekam, Matthew Marquez, Alberto Olmo, et al.2022 · 209 citations
  85. Compressing Context to Enhance Inference Efficiency of Large Language ModelsYucheng Li, Bo Dong, Frank Guerin, et al.2023 · 208 citations
  86. Active Example Selection for In-Context LearningYiming Zhang, Shi Feng, Chenhao Tan2022 · 207 citations
  87. Prompting GPT-3 To Be ReliableChenglei Si, Zhe Gan, Zhengyuan Yang, et al.2022 · 206 citations
  88. LLM+P: Empowering Large Language Models with Optimal Planning ProficiencyBo Liu, Yuqian Jiang, Xiaohan Zhang, et al.2023 · 204 citations
  89. mGPT: Few-Shot Learners Go MultilingualOleh Shliazhko, Alena Fenogenova, Maria Tikhonova, et al.2022 · 203 citations
  90. Large Language Model as Attributed Training Data Generator: A Tale of Diversity and BiasYue Yu, Yuchen Zhuang, Jieyu Zhang, et al.2023 · 198 citations
  91. The Unreliability of Explanations in Few-shot Prompting for Textual ReasoningXi Ye, Greg Durrett2022 · 196 citations
  92. OmniQuant: Omnidirectionally Calibrated Quantization for Large Language ModelsWenqi Shao, Mengzhao Chen, Zhaoyang Zhang, et al.2023 · 193 citations
  93. LLM in a flash: Efficient Large Language Model Inference with Limited MemoryKeivan Alizadeh, Seyed Iman Mirzadeh, Dmitry Belenko, et al.2024 · 192 citations
  94. MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningJun Chen, Deyao Zhu, Xiaoqian Shen, et al.2023 · 192 citations
  95. PandaLM: An Automatic Evaluation Benchmark for LLM Instruction Tuning OptimizationYidong Wang, Zhuohao Yu, Zhengran Zeng, et al.2023 · 189 citations
  96. SemEval-2023 Task 10: Explainable Detection of Online SexismHannah Kirk, Wenjie Yin, Bertie Vidgen, et al.2023 · 185 citations
  97. OBELICS: An Open Web-Scale Filtered Dataset of Interleaved Image-Text DocumentsHugo Laurençon, Lucile Saulnier, Leo Tronchon, et al.2023 · 183 citations
  98. Memorization Without Overfitting: Analyzing the Training Dynamics of Large Language ModelsKushal Tirumala, Aram H. Markosyan, Luke Zettlemoyer, et al.2022 · 183 citations
  99. GrIPS: Gradient-free, Edit-based Instruction Search for Prompting Large Language ModelsArchiki Prasad, Peter Hase, Xiang Zhou, et al.2023 · 180 citations
  100. On Second Thought, Let's Not Think Step by Step! Bias and Toxicity in Zero-Shot ReasoningOmar Shaikh, Hongxin Zhang, William Held, et al.2023 · 180 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/papers/zhang-2022-opt-open-pre-trained-transformer/cited-by/