Alex J. Smola
Alex J. Smola has 5 papers in our library, in 2015–2023, most of them on Language models & pretraining, Reasoning, Question answering; often with Aston Zhang, Mu Li, Diyi Yang.
OpenAlex · h-index 78 · 202 works · 63,485 citations OpenAlex, 2026-10-14
📄 5 works in our library · 🔗 Cited 1,869 times in our library · 25 more in our library without a page yet · ⭐ Paper Stars ranking: #374
Affiliations
Fields, topics and concepts
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Computer Science · 5 worksComputer Vision and Pattern Recognition · 4 worksArts and Humanities · 4 worksArtificial Intelligence · 4 worksLanguage and Linguistics · 4 works
🧭 Topics 4Research subjects and languages the work is about.Question answering · 1 workLanguage models & pretraining · 2 worksReasoning · 2 worksVision & language · 1 work
💡 Concepts 3Key ideas and methods explained on our concept pages.Text classification · 1 workQuestion answering · 1 workFew-shot learning · 1 work
Works by year
2020s
2010s
Papers
- Hierarchical Attention Networks for Document Classification (2016 · 5,436 citations)
The paper addresses document-level text classification, such as predicting review ratings or question topics. - Stacked Attention Networks for Image Question Answering (2015 · 2,157 citations)
The paper addresses image question answering (QA): answering a natural-language question about a given picture. - Automatic Chain of Thought Prompting in Large Language Models (2022 · 695 citations)
Chain-of-thought prompting works best when a model sees a few worked examples, but writing those examples by hand is slow and has to be redone for each task. - Multimodal Chain-of-Thought Reasoning in Language Models (2023 · 308 citations)
Chain-of-thought (CoT) prompting helps large language models solve multi-step problems, but earlier work used text only. - Parameter-Efficient Fine-Tuning Design Spaces (2023 · 47 citations)
Existing parameter-efficient fine-tuning (PEFT) techniques such as Adapter, Prefix tuning, BitFit and LoRA were each designed by hand and usually applied identically to every layer.
All works
- Hierarchical Attention Networks for Document ClassificationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Zichao Yang, Diyi Yang, Chris Dyer, et al.2016 · 5,436 citations
- Stacked Attention Networks for Image Question AnsweringIEEE Computer Society Conference on Computer Vision and Pattern RecognitionZichao Yang, Xiaodong He, Jianfeng Gao, et al.2015 · 2,157 citations
- Feature hashing for large scale multitask learning ↗International Conference on Machine Learning · no summary yetKilian Q. Weinberger et al.2009 · 958 citations
- Automatic Chain of Thought Prompting in Large Language ModelsarXiv:2210.03493Zhuosheng Zhang, Aston Zhang, Mu Li, et al.2022 · 695 citations
- Learning Graph Matching ↗IEEE Transactions on Pattern Analysis and Machine Intelligence · no summary yetTibério S. Caetano et al.383 citations
- COFI RANK - Maximum margin matrix factorization for collaborative ranking ↗HAL (Le Centre pour la Communication Scientifique Directe) · no summary yetMarkus Weimer et al.2007 · 349 citations
- Fastfood: approximating kernel expansions in loglinear time ↗no summary yetQuoc Viet Le, Tamás Sarlós, Alex J. Smola2013 · 317 citations
- Multimodal Chain-of-Thought Reasoning in Language ModelsarXiv:2302.00923Zhuosheng Zhang, Aston Zhang, Mu Li, et al.2023 · 308 citations
- Hilbert space embeddings of conditional distributions with applications to dynamical systems ↗International Conference on Machine Learning · no summary yetLe Song et al.2009 · 255 citations
- Bundle Methods for Regularized Risk Minimization ↗no summary yetChoon Hui Teo et al.2010 · 227 citations
- Deep Sets ↗arXiv (Cornell University) · no summary yetManzil Zaheer et al.2017 · 199 citations
- Slow Learners are Fast ↗neural information processing systems · no summary yetMartin Zinkevich, John C. Langford, Alex J. Smola2009 · 196 citations
- Heteroscedastic Gaussian process regression ↗International Conference on Machine Learning · no summary yetQuoc Viet Le, Alex J. Smola, Stéphane Canu2005 · 181 citations
- A scalable modular convex solver for regularized risk minimization ↗ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD) · no summary yetChoon Hui Teo et al.2007 · 174 citations
- Estimating Labels from Label Proportions ↗no summary yetNovi Quadrianto et al.2009 · 154 citations
- Super-Samples from Kernel Herding ↗arXiv (Cornell University) · no summary yetYutian Chen, Max Welling, Alex J. Smola2012 · 153 citations
- Bundle Methods for Machine Learning ↗neural information processing systems · no summary yetQuoc Viet Le, Alex J. Smola, S. V. N. Vishwanathan2007 · 124 citations
- Fastfood - Computing Hilbert Space Expansions in loglinear time ↗International Conference on Machine Learning · no summary yetQuoc Viet Le, Tamás Sarlós, Alexander Johannes Smola2013 · 101 citations
- Proximal stochastic methods for nonsmooth nonconvex finite-sum optimization ↗neural information processing systems · no summary yetSashank Jakkam Reddi et al.2016 · 96 citations
- Direct Optimization of Ranking Measures ↗arXiv (Cornell University) · no summary yetQuoc Viet Le, Alexander Johannes Smola2007 · 94 citations
- Symbolic Music Generation with Transformer-GANs ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetAashiq Muhamed et al.2021 · 66 citations
- Tighter Bounds for Structured Estimation ↗no summary yetOlivier Chapelle et al.2008 · 62 citations
- Learning Graph Matching ↗IEEE International Conference on Computer Vision (ICCV) · no summary yetTibério S. Caetano et al.2007 · 62 citations
- A Generic Approach for Escaping Saddle points ↗arXiv (Cornell University) · no summary yetSashank Jakkam Reddi et al.2017 · 52 citations
- Parameter-Efficient Fine-Tuning Design SpacesarXiv:2301.01821Jiaao Chen, Aston Zhang, Xingjian Shi, et al.2023 · 47 citations
See all 30 works by Alex J. Smola →
Co-authors here
- Aston Zhang ×3
- Mu Li ×3
- Diyi Yang ×2
- Xiaodong He ×2
- Zhuosheng Zhang ×2
- Zichao Yang ×2
- Chris Dyer
- Eduard Hovy
- Hai Zhao
- Jiaao Chen
- Jianfeng Gao
- Li Deng
Venues
- International Conference on Machine Learning ×5
- neural information processing systems ×3
- IEEE Computer Society Conference on Computer Vision and Pattern Recognition: IEEE Computer Society Conference on Computer Vision and Pattern Recognition 2015
- Conference of the North American Chapter of the Association for Computational Linguistics (NAACL): NAACL 2016
- ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD)
- HAL (Le Centre pour la Communication Scientifique Directe)
- IEEE International Conference on Computer Vision (ICCV)
- IEEE Transactions on Pattern Analysis and Machine Intelligence
- Lecture notes in computer science
- Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
- Proceedings of the AAAI Conference on Artificial Intelligence
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/alex-j-smola/