Who cites Dirk Weissenborn
- Swin Transformer: Hierarchical Vision Transformer using Shifted WindowsIEEE/CVF International Conference on Computer Vision (ICCV)Ze Liu, Yutong Lin, Yue Cao, et al.2021 · 33,968 citations
- An Image is Worth 16x16 Words: Transformers for Image Recognition at ScalearXiv:2010.11929Alexey Dosovitskiy, Lucas Beyer, Alexander Kolesnikov, et al.2020 · 23,726 citations
- Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
- BioBERT: a pre-trained biomedical language representation model for biomedical text miningBioinformaticsJinhyuk Lee, Wonjin Yoon, Sungdong Kim, et al.2019 · 8,339 citations
- The Llama 3 Herd of ModelsarXiv:2407.21783Aaron Grattafiori, Abhimanyu Dubey, Abhinav Jauhri, et al.2024 · 7,682 citations
- Emerging Properties in Self-Supervised Vision TransformersIEEE/CVF International Conference on Computer Vision (ICCV)Mathilde Caron, Hugo Touvron, Ishan Misra, et al.2021 · 6,046 citations
- Survey of Hallucination in Natural Language GenerationACM Computing SurveysZiwei Ji, Nayeon Lee, Rita Frieske, et al.2022 · 5,974 citations
- Know What You Don't Know: Unanswerable Questions for SQuADAnnual Meeting of the Association for Computational Linguistics (ACL)Pranav Rajpurkar, Robin Jia, Percy Liang2018 · 3,405 citations
- On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
- Gemini: A Family of Highly Capable Multimodal ModelsarXiv:2312.11805Gemini Team, Rohan Anil, Sebastian Borgeaud, et al.2023 · 3,050 citations
- Hierarchical Text-Conditional Image Generation with CLIP LatentsarXiv:2204.06125Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, et al.2022 · 2,713 citations
- Scalable Diffusion Models with TransformersIEEE/CVF International Conference on Computer Vision (ICCV)William Peebles, Saining Xie2022 · 2,670 citations
- Improved Baselines with Visual Instruction TuningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionHaotian Liu, Chunyuan Li, Yuheng Li, et al.2023 · 2,614 citations
- Adversarial Examples for Evaluating Reading Comprehension SystemsRobin Jia, Percy Liang2017 · 1,969 citations
- Scaling Up Visual and Vision-Language Representation Learning With Noisy Text SupervisionInternational Conference on Machine Learning (ICML)Chao Jia, Yinfei Yang, Ye Xia, et al.2021 · 1,615 citations
- CLIPScore: A Reference-free Evaluation Metric for Image CaptioningConference on Empirical Methods in Natural Language Processing (EMNLP)Jack Hessel, Ari Holtzman, Maxwell Forbes, et al.2021 · 1,550 citations
- Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
- BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationarXiv:2201.12086Junnan Li, Dongxu Li, Caiming Xiong, et al.2022 · 1,523 citations
- DINOv2: Learning Robust Visual Features without SupervisionarXiv:2304.07193Maxime Oquab, Timothee Darcet, Theo Moutakanni, et al.2023 · 1,513 citations
- LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,485 citations
- A Comprehensive Overview of Large Language ModelsACM Transactions on Intelligent Systems and TechnologyHumza Naveed, Asad Ullah Khan, Shi Qiu, et al.2023 · 1,287 citations
- The Rise and Potential of Large Language Model Based Agents: A SurveyScience China Information SciencesZhiheng Xi, Wenxiang Chen, Xin Guo, et al.2023 · 1,272 citations
- Vision-Language Models for Vision Tasks: A SurveyIEEE Transactions on Pattern Analysis and Machine IntelligenceJingyi Zhang, Jiaxing Huang, Sheng Jin, et al.2023 · 1,047 citations
- The NarrativeQA Reading Comprehension ChallengeTomáš Kočiský, Jonathan Schwarz, Phil Blunsom, et al.2018 · 1,042 citations
- MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIIEEE Computer Society Conference on Computer Vision and Pattern RecognitionXiang Yue, Yuansheng Ni, Kai Zhang, et al.2023 · 1,005 citations
- Interpretable Machine Learning: Fundamental Principles and 10 Grand ChallengesarXiv:2103.11251 · Statistics Surveys, 2021Cynthia Rudin; Chaofan Chen; Zhi Chen; Haiyang Huang; Lesia Semenova;, Chudi Zhong2021 · 974 citations
- Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and BeyondarXiv:2308.12966Jinze Bai, Shuai Bai, Shusheng Yang, et al.2023 · 970 citations
- Segment AnythingarXiv:2304.02643Alexander Kirillov, Eric Mintun, Nikhila Ravi, et al.2023 · 960 citations
- ImageBind: One Embedding Space To Bind Them AllIEEE Computer Society Conference on Computer Vision and Pattern RecognitionRohit Girdhar, Alaaeldin El-Nouby, Zhuang Liu, et al.2023 · 954 citations
- Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any ResolutionarXiv:2409.12191Peng Wang, Shuai Bai, Sinan Tan, et al.2024 · 860 citations
- MAD-X: An Adapter-Based Framework for Multi-Task Cross-Lingual TransferConference on Empirical Methods in Natural Language Processing (EMNLP)Jonas Pfeiffer, Ivan Vulić, Iryna Gurevych, et al.2020 · 839 citations
- Gated Self-Matching Networks for Reading Comprehension and Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Wenhui Wang, Nan Yang, Furu Wei, et al.2017 · 833 citations
- ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionarXiv:2102.03334Wonjae Kim, Bokyung Son, Ildoo Kim2021 · 804 citations
- LayoutLMv3: Pre-training for Document AI with Unified Text and Image MaskingACM International Conference on Multimedia (ACM MM)Yupan Huang, Tengchao Lv, Lei Cui, et al.2022 · 778 citations
- ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical ReasoningFindings of the Association for Computational LinguisticsAhmed Masry, Do Xuan Long, Jia Qing Tan, et al.2022 · 774 citations
- HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging FaceConference on Neural Information Processing Systems (NeurIPS)Yongliang Shen, Kaitao Song, Xu Tan, et al.2023 · 756 citations
- Transfer Learning in Natural Language ProcessingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Sebastian Ruder, Matthew E. Peters, Swabha Swayamdipta, et al.2019 · 708 citations
- ELI5: Long Form Question AnsweringAnnual Meeting of the Association for Computational Linguistics (ACL)Angela Fan, Yacine Jernite, Ethan Perez, et al.2019 · 695 citations
- CoCa: Contrastive Captioners are Image-Text Foundation ModelsarXiv:2205.01917Jiahui Yu, Zirui Wang, Vijay Vasudevan, et al.2022 · 667 citations
- A Time Series is Worth 64 Words: Long-term Forecasting with TransformersarXiv:2211.14730Yuqi Nie, Nam H. Nguyen, Phanwadee Sinthong, et al.2022 · 627 citations
- FNet: Mixing Tokens with Fourier TransformsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)James Lee-Thorp, Joshua Ainslie, Ilya Eckstein, et al.2022 · 597 citations
- QANet: Combining Local Convolution with Global Self-Attention for Reading ComprehensionarXiv:1804.09541Adams Wei Yu, David Dohan, Minh-Thang Luong, et al.2018 · 597 citations
- OCR-free Document Understanding TransformerLecture notes in computer scienceGeewook Kim, Teakgyu Hong, Moonbin Yim, et al.2021 · 584 citations
- Simple and Effective Multi-Paragraph Reading ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Christopher Clark, Matt Gardner2017 · 562 citations
- The Natural Language Decathlon: Multitask Learning as Question AnsweringarXiv:1806.08730Bryan McCann, Nitish Shirish Keskar, Caiming Xiong, et al.2018 · 545 citations
- Training data-efficient image transformers & distillation through attentionarXiv:2012.12877Hugo Touvron, Matthieu Cord, Matthijs Douze, et al.2020 · 524 citations
- Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference timearXiv:2203.05482Mitchell Wortsman, Gabriel Ilharco, Samir Yitzhak Gadre, et al.2022 · 507 citations
- Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space ModelarXiv:2401.09417Lianghui Zhu, Bencheng Liao, Qian Zhang, et al.2024 · 500 citations
- SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionarXiv:2108.10904Zirui Wang, Jiahui Yu, Adams Wei Yu, et al.2021 · 481 citations
- OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkarXiv:2202.03052Peng Wang, An Yang, Rui Men, et al.2022 · 467 citations
- InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic TasksarXiv:2312.14238Zhe Chen, Jiannan Wu, Wenhai Wang, et al.2023 · 435 citations
- Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video AnalysisIEEE Computer Society Conference on Computer Vision and Pattern RecognitionChaoyou Fu, Yuhan Dai, Yongdong Luo, et al.2024 · 427 citations
- mPLUG-Owl: Modularization Empowers Large Language Models with MultimodalityarXiv:2304.14178Qinghao Ye, Haiyang Xu, Guohai Xu, et al.2023 · 427 citations
- PaLI: A Jointly-Scaled Multilingual Language-Image ModelarXiv:2209.06794Xi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 371 citations
- CogAgent: A Visual Language Model for GUI AgentsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionWenyi Hong, Weihan Wang, Qingsong Lv, et al.2023 · 367 citations
- Parameter-Efficient Transfer Learning with Diff PruningAnnual Meeting of the Association for Computational Linguistics (ACL)Demi Guo, Alexander Rush, Yoon Kim2021 · 367 citations
- SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational AbilitiesFindings of the Association for Computational LinguisticsDong Zhang, Shimin Li, Xin Zhang, et al.2023 · 347 citations
- MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesarXiv:2308.02490Weihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 344 citations
- LLaMA-Adapter: Efficient Fine-tuning of Language Models with Zero-init AttentionarXiv:2303.16199Renrui Zhang, Jiaming Han, Chris Liu, et al.2023 · 333 citations
- TIES-Merging: Resolving Interference When Merging ModelsConference on Neural Information Processing Systems (NeurIPS)Prateek Yadav, Derek Tam, Leshem Choshen, et al.2023 · 324 citations
- Eyes Wide Shut? Exploring the Visual Shortcomings of Multimodal LLMsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionShengbang Tong, Zhuang Liu, Yuexiang Zhai, et al.2024 · 321 citations
- MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
- WIT: Wikipedia-based Image Text Dataset for Multimodal Multilingual Machine LearningInternational ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR)Krishna Srinivasan, Karthik Raman, Jiecao Chen, et al.2021 · 315 citations
- Multimodal Chain-of-Thought Reasoning in Language ModelsarXiv:2302.00923Zhuosheng Zhang, Aston Zhang, Mu Li, et al.2023 · 308 citations
- Socratic Models: Composing Zero-Shot Multimodal Reasoning with LanguagearXiv:2204.00598Andy Zeng, Maria Attarian, Brian Ichter, et al.2022 · 302 citations
- Constructing Datasets for Multi-hop Reading Comprehension Across DocumentsTransactions of the Association for Computational Linguistics (TACL)Johannes Welbl, Pontus Stenetorp, Sebastian Riedel2018 · 290 citations
- Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time ScalingarXiv:2412.05271Zhe Chen, Weiyun Wang, Yue Cao, et al.2024 · 287 citations
- Scaling Laws for Autoregressive Generative ModelingarXiv:2010.14701Tom Henighan, Jared Kaplan, Mor Katz, et al.2020 · 277 citations
- Reinforced Mnemonic Reader for Machine Reading ComprehensionInternational Joint Conference on Artificial IntelligenceMinghao Hu, Yuxing Peng, Zhen Huang, et al.2017 · 273 citations
- Perceiver: General Perception with Iterative AttentionarXiv:2103.03206Andrew Jaegle, Felix Gimeno, Andrew Brock, et al.2021 · 269 citations
- LLaMA-VID: An Image is Worth 2 Tokens in Large Language ModelsLecture notes in computer scienceYanwei Li, Chengyao Wang, Jiaya Jia2023 · 262 citations
- InternVideo2: Scaling Foundation Models for Multimodal Video UnderstandingLecture notes in computer scienceYi Wang, Kunchang Li, Xinhao Li, et al.2024 · 253 citations
- Language Models can Solve Computer TasksConference on Neural Information Processing Systems (NeurIPS)Geunwoo Kim, Pierre Baldi, Stephen McAleer2023 · 249 citations
- Transformers learn in-context by gradient descentarXiv:2212.07677Johannes von Oswald, Eyvind Niklasson, Ettore Randazzo, et al.2022 · 247 citations
- Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyarXiv:2403.14608Zeyu Han, Chao Gao, Jinyang Liu, et al.2024 · 240 citations
- Interpretation of Natural Language Rules in Conversational Machine ReadingConference on Empirical Methods in Natural Language Processing (EMNLP)Marzieh Saeidi, Max Bartolo, Patrick Lewis, et al.2018 · 230 citations
- LLaMA-Adapter V2: Parameter-Efficient Visual Instruction ModelarXiv:2304.15010Peng Gao, Jiaming Han, Renrui Zhang, et al.2023 · 229 citations
- DataComp: In search of the next generation of multimodal datasetsConference on Neural Information Processing Systems (NeurIPS)Samir Yitzhak Gadre, Gabriel Ilharco, Alex Fang, et al.2023 · 224 citations
- TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question AnsweringIEEE/CVF International Conference on Computer Vision (ICCV)Yushi Hu, Benlin Liu, Jungo Kasai, et al.2023 · 218 citations
- Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
- What Can Transformers Learn In-Context? A Case Study of Simple Function ClassesConference on Neural Information Processing Systems (NeurIPS)Shivam Garg, Dimitris Tsipras, Percy Liang, et al.2022 · 209 citations
- Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Shengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 208 citations
- Merging Models with Fisher-Weighted AveragingConference on Neural Information Processing Systems (NeurIPS)Michael Matena, Colin Raffel2021 · 208 citations
- DyLoRA: Parameter-Efficient Tuning of Pre-trained Models using Dynamic Search-Free Low-Rank AdaptationConference of the European Chapter of the Association for Computational Linguistics (EACL)Mojtaba Valipour, Mehdi Rezagholizadeh, Ivan Kobyzev, et al.2023 · 203 citations
- MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and TextConference on Empirical Methods in Natural Language Processing (EMNLP)Wenhu Chen, Hexiang Hu, Xi Chen, et al.2022 · 199 citations
- Will we run out of data? Limits of LLM scaling based on human-generated dataarXiv:2211.04325Pablo Villalobos, Anson Ho, Jaime Sevilla, et al.2022 · 198 citations
- Efficient and Robust Question Answering from Minimal Context over DocumentsAnnual Meeting of the Association for Computational Linguistics (ACL)Sewon Min, Victor Zhong, Richard Socher, et al.2018 · 197 citations
- MM-REACT: Prompting ChatGPT for Multimodal Reasoning and ActionarXiv:2303.11381Zhengyuan Yang, Linjie Li, Jianfeng Wang, et al.2023 · 196 citations
- WebVoyager: Building an End-to-End Web Agent with Large Multimodal ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hongliang He, Wenlin Yao, Kaixin Ma, et al.2024 · 191 citations
- CogVideo: Large-scale Pretraining for Text-to-Video Generation via TransformersarXiv:2205.15868Wenyi Hong, Ming Ding, Wendi Zheng, et al.2022 · 191 citations
- DuoRC: Towards Complex Language Understanding with Paraphrased Reading ComprehensionAnnual Meeting of the Association for Computational Linguistics (ACL)Amrita Saha, Rahul Aralikatte, Mitesh M. Khapra, et al.2018 · 190 citations
- Eliciting Latent Predictions from Transformers with the Tuned LensarXiv:2303.08112Nora Belrose, Igor Ostrovsky, Lev McKinney, et al.2023 · 188 citations
- What Makes Reading Comprehension Questions Easier?Conference on Empirical Methods in Natural Language Processing (EMNLP)Saku Sugawara, Kentaro Inui, Satoshi Sekine, et al.2018 · 179 citations
- On the Robustness of ChatGPT: An Adversarial and Out-of-distribution PerspectivearXiv:2302.12095Jindong Wang, Xixu Hu, Wenxin Hou, et al.2023 · 176 citations
- Diffusion Policy: Visuomotor Policy Learning via Action DiffusionarXiv:2303.04137Cheng Chi, Zhenjia Xu, Siyuan Feng, et al.2023 · 173 citations
- Weak-to-Strong Generalization: Eliciting Strong Capabilities With Weak SupervisionarXiv:2312.09390Collin Burns, Pavel Izmailov, Jan Hendrik Kirchner, et al.2023 · 172 citations
- Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional NetworkAnnual Meeting of the Association for Computational Linguistics (ACL)Bin Liang, Chenwei Lou, Xiang Li, et al.2022 · 172 citations
- Improving Machine Reading Comprehension with General Reading StrategiesConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Kai Sun, Dian Yu, Dong Yu, et al.2019 · 172 citations
- QuALITY: Question Answering with Long Input Texts, Yes!Conference of the North American Chapter of the Association for Computational Linguistics (NAACL)Richard Yuanzhe Pang, Alicia Parrish, Nitish Joshi, et al.2022 · 167 citations
- Question Answering for Privacy Policies: Combining Computational and Legal PerspectivesConference on Empirical Methods in Natural Language Processing (EMNLP)Abhilasha Ravichander, Alan W Black, Shomir Wilson, et al.2019 · 163 citations
This page in Markdown → https://md.research.elamur.ai/free/en/authors/dirk-weissenborn/cited-by/