Elamur Research⌕
☰
home / authors / Justin M. Johnson / cited by

Who cites Justin M. Johnson

1,766 citations of their works from 1,478 papers of our library (of the 149,439 whose bibliographies we read) · 176 with a page here, the most cited first · page 1 of 2 · 1–100 · ← Justin M. Johnson

1 2

  1. Learning Transferable Visual Models From Natural Language SupervisionarXiv:2103.00020Alec Radford, Jong Wook Kim, Chris Hallacy, et al.2021 · 8,767 citations
  2. Grad-CAM: Visual Explanations from Deep Networks via Gradient-based LocalizationInternational Journal of Computer VisionRamprasaath R. Selvaraju, Michael Cogswell, Abhishek Das, et al.2016 · 6,394 citations
  3. Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image AnnotationsInternational Journal of Computer VisionRanjay Krishna, Yuke Zhu, Oliver Groth, et al.2016 · 5,876 citations
  4. On the Opportunities and Risks of Foundation ModelsarXiv:2108.07258Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, et al.2021 · 3,160 citations
  5. LXMERT: Learning Cross-Modality Encoder Representations from TransformersConference on Empirical Methods in Natural Language Processing (EMNLP)Hao Tan, Mohit Bansal2019 · 2,789 citations
  6. Improved Baselines with Visual Instruction TuningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionHaotian Liu, Chunyuan Li, Yuheng Li, et al.2023 · 2,614 citations
  7. UNITER: UNiversal Image-TExt Representation LearningLecture notes in computer scienceYen-Chun Chen, Linjie Li, Licheng Yu, et al.2019 · 2,418 citations
  8. ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language TasksarXiv:1908.02265Jiasen Lu, Dhruv Batra, Devi Parikh, et al.2019 · 2,302 citations
  9. BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language ModelsarXiv:2301.12597Junnan Li, Dongxu Li, Silvio Savarese, et al.2023 · 2,219 citations
  10. GQA: A New Dataset for Real-World Visual Reasoning and Compositional Question AnsweringIEEE Computer Society Conference on Computer Vision and Pattern RecognitionDrew A. Hudson, Christopher D. Manning2019 · 2,078 citations
  11. Oscar: Object-Semantics Aligned Pre-training for Vision-Language TasksLecture notes in computer scienceXiujun Li, Xi Yin, Chunyuan Li, et al.2020 · 1,877 citations
  12. Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelsarXiv:2206.04615 · Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5BvosjAarohi Srivastava, Abhinav Rastogi, Abhishek Rao, et al.2022 · 1,756 citations
  13. Multimodal Compact Bilinear Pooling for Visual Question Answering and Visual GroundingConference on Empirical Methods in Natural Language Processing (EMNLP)Akira Fukui, Dong Huk Park, Daylen Yang, et al.2016 · 1,684 citations
  14. Scaling Up Visual and Vision-Language Representation Learning With Noisy Text SupervisionInternational Conference on Machine Learning (ICML)Chao Jia, Yinfei Yang, Ye Xia, et al.2021 · 1,615 citations
  15. VisualBERT: A Simple and Performant Baseline for Vision and LanguagearXiv:1908.03557Liunian Harold Li, Mark Yatskar, Da Yin, et al.2019 · 1,568 citations
  16. BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and GenerationarXiv:2201.12086Junnan Li, Dongxu Li, Caiming Xiong, et al.2022 · 1,523 citations
  17. LAION-5B: An open large-scale dataset for training next generation image-text modelsarXiv:2210.08402Christoph Schuhmann, Romain Beaumont, Richard Vencu, et al.2022 · 1,485 citations
  18. Contextual String Embeddings for Sequence LabelingInternational Conference on Computational Linguistics (COLING)Alan Akbik, Duncan Blythe, Roland Vollgraf2018 · 1,400 citations
  19. Generation and Comprehension of Unambiguous Object DescriptionsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJunhua Mao, Jonathan Huang, Alexander Toshev, et al.2015 · 1,388 citations
  20. Making the V in VQA Matter: Elevating the Role of Image Understanding in Visual Question AnsweringInternational Journal of Computer VisionYash Goyal, Tejas Khot, Douglas Summers-Stay, et al.2016 · 1,281 citations
  21. PIQA: Reasoning about Physical Commonsense in Natural LanguageProceedings of the AAAI Conference on Artificial IntelligenceYonatan Bisk, Rowan Zellers, Ronan Le Bras, et al.2019 · 1,264 citations
  22. Assessing the Ability of LSTMs to Learn Syntax-Sensitive DependenciesTransactions of the Association for Computational Linguistics (TACL)Tal Linzen, Emmanuel Dupoux, Yoav Goldberg2016 · 1,256 citations
  23. Modeling Context in Referring ExpressionsLecture notes in computer scienceLicheng Yu, Patrick Poirson, Shan Yang, et al.2016 · 1,203 citations
  24. MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language ModelsarXiv:2304.10592Deyao Zhu, Jun Chen, Xiaoqian Shen, et al.2023 · 1,141 citations
  25. Recurrent Attention Network on Memory for Aspect Sentiment AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP)Peng Chen, Zhongqian Sun, Lidong Bing, et al.2017 · 1,119 citations
  26. VL-BERT: Pre-training of Generic Visual-Linguistic RepresentationsarXiv:1908.08530Weijie Su, Xizhou Zhu, Yue Cao, et al.2019 · 1,066 citations
  27. Linguistic Knowledge and Transferability of Contextual RepresentationsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Nelson F. Liu, Matt Gardner, Yonatan Belinkov, et al.2019 · 1,021 citations
  28. Interpretable Machine Learning: Fundamental Principles and 10 Grand ChallengesarXiv:2103.11251 · Statistics Surveys, 2021Cynthia Rudin; Chaofan Chen; Zhi Chen; Haiyang Huang; Lesia Semenova;, Chudi Zhong2021 · 974 citations
  29. Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and BeyondarXiv:2308.12966Jinze Bai, Shuai Bai, Shusheng Yang, et al.2023 · 970 citations
  30. Visual7W: Grounded Question Answering in ImagesIEEE Computer Society Conference on Computer Vision and Pattern RecognitionYuke Zhu, Oliver Groth, Michael Bernstein, et al.2015 · 952 citations
  31. MMBench: Is Your Multi-modal Model an All-around Player?Lecture notes in computer scienceYuan Liu, Haodong Duan, Yuanhan Zhang, et al.2023 · 942 citations
  32. Simple and Accurate Dependency Parsing Using Bidirectional LSTM Feature RepresentationsEliyahu Kiperwasser, Yoav Goldberg2016 · 909 citations
  33. LayoutLM: Pre-training of Text and Layout for Document Image UnderstandingarXiv:1912.13318Yiheng Xu, Minghao Li, Lei Cui, et al.2019 · 896 citations
  34. Visualizing and Understanding Neural Models in NLPConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Jiwei Li, Xinlei Chen, Eduard Hovy, et al.2016 · 855 citations
  35. DocVQA: A Dataset for VQA on Document ImagesarXiv:2007.00398Minesh Mathew, Dimosthenis Karatzas, C.V. Jawahar2020 · 844 citations
  36. ViLT: Vision-and-Language Transformer Without Convolution or Region SupervisionarXiv:2102.03334Wonjae Kim, Bokyung Son, Ildoo Kim2021 · 804 citations
  37. Semi-supervised sequence tagging with bidirectional language modelsAnnual Meeting of the Association for Computational Linguistics (ACL)Matthew E. Peters, Waleed Ammar, Chandra Bhagavatula, et al.2017 · 795 citations
  38. Reproducible scaling laws for contrastive language-image learningIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMehdi Cherti, Romain Beaumont, Ross Wightman, et al.2022 · 769 citations
  39. Analysis Methods in Neural Language Processing: A SurveyTransactions of the Association for Computational Linguistics (TACL)Yonatan Belinkov, James Glass2019 · 740 citations
  40. TVQA: Localized, Compositional Video Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Jie Lei, Licheng Yu, Mohit Bansal, et al.2018 · 687 citations
  41. A Corpus for Reasoning About Natural Language Grounded in Photographs (NLVR2)Alane Suhr, Stephanie Zhou, Ally Zhang, et al.2019 · 670 citations
  42. A simple neural network module for relational reasoningarXiv:1706.01427Adam Santoro, David Raposo, David G. T. Barrett, et al.2017 · 632 citations
  43. Object Hallucination in Image CaptioningConference on Empirical Methods in Natural Language Processing (EMNLP)Anna Rohrbach, Lisa Anne Hendricks, Kaylee Burns, et al.2018 · 626 citations
  44. Fine-grained Analysis of Sentence Embeddings Using Auxiliary Prediction TasksarXiv:1608.04207Yossi Adi, Einat Kermany, Yonatan Belinkov, et al.2016 · 599 citations
  45. Dissecting Contextual Word Embeddings: Architecture and RepresentationConference on Empirical Methods in Natural Language Processing (EMNLP)Matthew E. Peters, Mark Neumann, Luke Zettlemoyer, et al.2018 · 592 citations
  46. How Far Are We to GPT-4V? Closing the Gap to Commercial Multimodal Models with Open-Source SuitesScience China Information SciencesZhe Chen, Weiyun Wang, Hao Tian, et al.2024 · 541 citations
  47. A-OKVQA: A Benchmark for Visual Question Answering using World KnowledgeLecture notes in computer scienceDustin Schwenk, Apoorv Khandelwal, Christopher Clark, et al.2022 · 509 citations
  48. Does String-Based Neural MT Learn Source Syntax?Conference on Empirical Methods in Natural Language Processing (EMNLP)Xing Shi, Inkit Padhi, Kevin Knight2016 · 504 citations
  49. What do Neural Machine Translation Models Learn about Morphology?Annual Meeting of the Association for Computational Linguistics (ACL)Yonatan Belinkov, Nadir Durrani, Fahim Dalvi, et al.2017 · 487 citations
  50. On the Automatic Generation of Medical Imaging ReportsAnnual Meeting of the Association for Computational Linguistics (ACL)Baoyu Jing, Pengtao Xie, Eric Xing2018 · 484 citations
  51. SimVLM: Simple Visual Language Model Pretraining with Weak SupervisionarXiv:2108.10904Zirui Wang, Jiahui Yu, Adams Wei Yu, et al.2021 · 481 citations
  52. LLaVA-OneVision: Easy Visual Task TransferarXiv:2408.03326Bo Li, Yuanhan Zhang, Dong Guo, et al.2024 · 477 citations
  53. Learning to Generate Reviews and Discovering SentimentarXiv:1704.01444Alec Radford, Rafal Jozefowicz, Ilya Sutskever2017 · 474 citations
  54. Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object DetectionarXiv:2303.05499Shilong Liu, Zhaoyang Zeng, Tianhe Ren, et al.2023 · 472 citations
  55. OFA: Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning FrameworkarXiv:2202.03052Peng Wang, An Yang, Rui Men, et al.2022 · 467 citations
  56. CLEVR: A Diagnostic Dataset for Compositional Language and Elementary Visual ReasoningarXiv:1612.06890Justin Johnson, Bharath Hariharan, Laurens van der Maaten, et al.2016 · 464 citations
  57. MVBench: A Comprehensive Multi-modal Video Understanding BenchmarkIEEE Computer Society Conference on Computer Vision and Pattern RecognitionKunchang Li, Yali Wang, Yinan He, et al.2023 · 463 citations
  58. ShareGPT4V: Improving Large Multi-Modal Models with Better CaptionsLecture notes in computer scienceLin Chen, Jinsong Li, Xiaoyi Dong, et al.2023 · 454 citations
  59. Experience Grounds LanguageConference on Empirical Methods in Natural Language Processing (EMNLP)Yonatan Bisk, Ari Holtzman, Jesse Thomason, et al.2020 · 439 citations
  60. The Hateful Memes Challenge: Detecting Hate Speech in Multimodal MemesarXiv:2005.04790Douwe Kiela, Hamed Firooz, Aravind Mohan, et al.2020 · 420 citations
  61. Yi: Open Foundation Models by 01.AIarXiv:2403.04652Alex Young, Bei Chen, Chao Li, et al.2024 · 408 citations
  62. ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question AnsweringProceedings of the AAAI Conference on Artificial IntelligenceZhou Yu, Dejing Xu, Jun Yu, et al.2019 · 403 citations
  63. FiLM: Visual Reasoning with a General Conditioning LayerarXiv:1709.07871Ethan Perez, Florian Strub, Harm de Vries, et al.2017 · 400 citations
  64. Open Sesame: Getting inside BERT's Linguistic KnowledgeProceedings of the 2019 ACL Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLPYongjie Lin, Yi Chern Tan, Robert Frank2019 · 385 citations
  65. CogVLM: Visual Expert for Pretrained Language ModelsConference on Neural Information Processing Systems (NeurIPS)Weihan Wang, Qingsong Lv, Wenmeng Yu, et al.2023 · 383 citations
  66. ViperGPT: Visual Inference via Python Execution for ReasoningIEEE/CVF International Conference on Computer Vision (ICCV)Didac Suris, Sachit Menon, Carl Vondrick2023 · 383 citations
  67. PaLI: A Jointly-Scaled Multilingual Language-Image ModelarXiv:2209.06794Xi Chen, Xiao Wang, Soravit Changpinyo, et al.2022 · 371 citations
  68. An Analysis of Encoder Representations in Transformer-Based Machine TranslationEMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLPAlessandro Raganato, Jörg Tiedemann2018 · 369 citations
  69. VideoChat: Chat-Centric Video UnderstandingScience China Information SciencesKunChang Li, Yinan He, Yi Wang, et al.2023 · 365 citations
  70. Visual StorytellingConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Ting-Hao Kenneth Huang, Francis Ferraro, Nasrin Mostafazadeh, et al.2016 · 356 citations
  71. Information-Theoretic Probing with Minimum Description LengthConference on Empirical Methods in Natural Language Processing (EMNLP)Elena Voita, Ivan Titov2020 · 345 citations
  72. MM-Vet: Evaluating Large Multimodal Models for Integrated CapabilitiesarXiv:2308.02490Weihao Yu, Zhengyuan Yang, Linjie Li, et al.2023 · 344 citations
  73. Discovering Language Model Behaviors with Model-Written EvaluationsarXiv:2212.09251Ethan Perez, Sam Ringer, Kamilė Lukošiūtė, et al.2022 · 328 citations
  74. Chameleon: Plug-and-Play Compositional Reasoning with Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Pan Lu, Baolin Peng, Hao Cheng, et al.2023 · 327 citations
  75. ALFWorld: Aligning Text and Embodied Environments for Interactive LearningarXiv:2010.03768Mohit Shridhar, Xingdi Yuan, Marc-Alexandre Côté, et al.2020 · 322 citations
  76. MM-LLMs: Recent Advances in MultiModal Large Language ModelsFindings of the Association for Computational LinguisticsDuzhen Zhang, Yahan Yu, Jiahua Dong, et al.2024 · 320 citations
  77. The Dawn of LMMs: Preliminary Explorations with GPT-4V(ision)arXiv:2309.17421Zhengyuan Yang, Linjie Li, Kevin Lin, et al.2023 · 311 citations
  78. UNIMO: Towards Unified-Modal Understanding and Generation via Cross-Modal Contrastive LearningAnnual Meeting of the Association for Computational Linguistics (ACL)Wei Li, Can Gao, Guocheng Niu, et al.2021 · 308 citations
  79. Learning to Write with Cooperative DiscriminatorsAnnual Meeting of the Association for Computational Linguistics (ACL)Ari Holtzman, Jan Buys, Maxwell Forbes, et al.2018 · 303 citations
  80. CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement LearningConference on Neural Information Processing Systems (NeurIPS)Hung Le, Yue Wang, Akhilesh Deepak Gotmare, et al.2022 · 297 citations
  81. SPICE: Semantic Propositional Image Caption EvaluationarXiv:1607.08822Peter Anderson, Basura Fernando, Mark Johnson, et al.2016 · 289 citations
  82. Kosmos-2: Grounding Multimodal Large Language Models to the WorldarXiv:2306.14824Zhiliang Peng, Wenhui Wang, Li Dong, et al.2023 · 286 citations
  83. MiniCPM-V: A GPT-4V Level MLLM on Your PhonearXiv:2408.01800Yuan Yao, Tianyu Yu, Ao Zhang, et al.2024 · 269 citations
  84. Multimodal Few-Shot Learning with Frozen Language ModelsarXiv:2106.13884Maria Tsimpoukelli, Jacob Menick, Serkan Cabi, et al.2021 · 258 citations
  85. Evaluating Layers of Representation in Neural Machine Translation on Part-of-Speech and Semantic Tagging TasksarXiv:1801.07772 · IJCNLP 8 (2017), volume 1, 1-10Yonatan Belinkov, Lluis Marquez, Hassan Sajjad, et al.2017 · 225 citations
  86. Break It Down: A Question Understanding BenchmarkTransactions of the Association for Computational Linguistics (TACL)Tomer Wolfson, Mor Geva, Ankit Gupta, et al.2020 · 222 citations
  87. Unsupervised Question Decomposition for Question AnsweringConference on Empirical Methods in Natural Language Processing (EMNLP)Ethan Perez, Patrick Lewis, Wen-tau Yih, et al.2020 · 222 citations
  88. Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language ModelsIEEE Computer Society Conference on Computer Vision and Pattern RecognitionMatt Deitke, Christopher Clark, Sangho Lee, et al.2024 · 216 citations
  89. What matters when building vision-language models?Conference on Neural Information Processing Systems (NeurIPS)Hugo Laurençon, Leo Tronchon, Matthieu Cord, et al.2024 · 212 citations
  90. Shikra: Unleashing Multimodal LLM's Referential Dialogue MagicarXiv:2306.15195Keqin Chen, Zhao Zhang, Weili Zeng, et al.2023 · 210 citations
  91. Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMsConference on Neural Information Processing Systems (NeurIPS)Shengbang Tong, Ellis Brown, Penghao Wu, et al.2024 · 208 citations
  92. Towards Faithful Model Explanation in NLP: A SurveyComputational LinguisticsQing Lyu, Marianna Apidianaki, Chris Callison-Burch2024 · 197 citations
  93. The emergence of number and syntax units in LSTM language modelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Yair Lakretz, German Kruszewski, Theo Desbordes, et al.2019 · 194 citations
  94. Representation of Linguistic Form and Function in Recurrent Neural NetworksComputational LinguisticsÁkos Kádár, Grzegorz Chrupała, Afra Alishahi2017 · 192 citations
  95. The Prompt Report: A Systematic Survey of Prompt Engineering TechniquesarXiv:2406.06608Sander Schulhoff, Michael Ilie, Nishant Balepur, et al.2024 · 189 citations
  96. Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction TuningarXiv:2306.14565Fuxiao Liu, Kevin Lin, Linjie Li, et al.2023 · 189 citations
  97. AudioCaps: Generating Captions for Audios in The WildConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Chris Dongjoo Kim, Byeongchang Kim, Hyunmin Lee, et al.2019 · 187 citations
  98. Learning Language Representations for Typology PredictionConference on Empirical Methods in Natural Language Processing (EMNLP)Chaitanya Malaviya, Graham Neubig, Patrick Littell2017 · 187 citations
  99. GeoQA: A Geometric Question Answering Benchmark Towards Multimodal Numerical ReasoningFindings of the Association for Computational LinguisticsJiaqi Chen, Jianheng Tang, Jinghui Qin, et al.2021 · 184 citations
  100. AllenNLP Interpret: A Framework for Explaining Predictions of NLP ModelsConference on Empirical Methods in Natural Language Processing (EMNLP)Eric Wallace, Jens Tuyls, Junlin Wang, et al.2019 · 182 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/justin-m-johnson/cited-by/