Elamur Research⌕
☰
home / authors / Yi Tay / all works

Yi Tay — all works

107 works · page 1 of 2 · 1–100 · ← Yi Tay

1 2

  1. Scaling Instruction-Finetuned Language Models ↗arXiv:2210.11416 · no summary yetHyung Won Chung et al.2022 · 3,392 citations
  2. Emergent Abilities of Large Language ModelsarXiv:2206.07682Jason Wei, Yi Tay, Rishi Bommasani, et al.2022 · 2,269 citations
  3. Deep Learning Based Recommender System ↗ACM Computing Surveys · no summary yetShuai Zhang et al.2019 · 1,547 citations
  4. Efficient Transformers: A SurveyACM Computing SurveysYi Tay, Mostafa Dehghani, Dara Bahri, et al.2020 · 1,539 citations
  5. Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve ThemFindings of the Association for Computational LinguisticsMirac Suzgun, Nathan Scales, Nathanael Schärli, et al.2023 · 1,119 citations
  6. The Flan Collection: Designing Data and Methods for Effective Instruction TuningarXiv:2301.13688Shayne Longpre, Le Hou, Tu Vu, et al.2023 · 607 citations
  7. Language Models are Multilingual Chain-of-Thought ReasonersarXiv:2210.03057Freda Shi, Mirac Suzgun, Markus Freitag, et al.2022 · 494 citations
  8. Long Range Arena: A Benchmark for Efficient TransformersarXiv:2011.04006Yi Tay, Mostafa Dehghani, Samira Abnar, et al.2020 · 414 citations
  9. UL2: Unifying Language Learning ParadigmsarXiv:2205.05131Yi Tay, Mostafa Dehghani, Vinh Q. Tran, et al.2022 · 347 citations
  10. Quaternion Knowledge Graph Embeddings ↗arXiv:1904.10281 · no summary yetShuai Zhang et al.2019 · 333 citations
  11. Larger language models do in-context learning differentlyarXiv:2303.03846Jerry Wei, Jason Wei, Yi Tay, et al.2023 · 285 citations
  12. Reasoning with Sarcasm by Reading In-BetweenAnnual Meeting of the Association for Computational Linguistics (ACL)Yi Tay, Anh Tuan Luu, Siu Cheung Hui, et al.2018 · 248 citations
  13. Synthesizer: Rethinking Self-Attention in Transformer Models ↗arXiv (Cornell University) · no summary yetYi Tay et al.2020 · 245 citations
  14. A New Generation of Perspective API: Efficient Multilingual Character-level Transformers ↗KDD 2022 · no summary yetAlyssa Lees et al.2022 · 238 citations
  15. Learning to Attend via Word-Aspect Associative Fusion for Aspect-Based Sentiment Analysis ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2018 · 233 citations
  16. Transformer Memory as a Differentiable Search IndexConference on Neural Information Processing Systems (NeurIPS)Yi Tay, Vinh Q. Tran, Mostafa Dehghani, et al.2022 · 223 citations
  17. Scaling Vision Transformers to 22 Billion Parameters ↗arXiv:2302.05442 · no summary yetMostafa Dehghani et al.2023 · 217 citations
  18. Sparse Sinkhorn Attention ↗arXiv (Cornell University) · no summary yetYi Tay et al.2020 · 200 citations
  19. Confident Adaptive Language Modeling ↗neural information processing systems · no summary yetTal Schuster et al.2022 · 197 citations
  20. Charformer: Fast Character Transformers via Gradient-based Subword TokenizationarXiv:2106.12672Yi Tay, Vinh Q. Tran, Sebastian Ruder, et al.2021 · 186 citations
  21. Recommender Systems with Generative Retrieval ↗neural information processing systems · no summary yetShashank Rajput et al.2023 · 182 citations
  22. SkipFlow: Incorporating Neural Coherence Features for End-to-End Automatic Text Scoring ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYi Tay et al.2018 · 172 citations
  23. Confusionset-guided Pointer Networks for Chinese Spelling Check ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetDingmin Wang, Yi Tay, Li Zhong2019 · 137 citations
  24. Simple and Effective Curriculum Pointer-Generator Networks for Reading Comprehension over Long Narratives ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetYi Tay et al.2019 · 133 citations
  25. Do Transformer Modifications Transfer Across Implementations and Applications? ↗Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing · no summary yetSharan Narang et al.2021 · 123 citations
  26. Recitation-Augmented Language Models ↗arXiv (Cornell University) · no summary yetZhiqing Sun et al.2022 · 119 citations
  27. Rethinking search ↗ACM SIGIR Forum · no summary yetDonald Metzler et al.2021 · 119 citations
  28. Compare, Compress and Propagate: Enhancing Neural Architectures with Alignment Factorization for Natural Language Inference ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetYi Tay, Anh Tuan Luu, Siu Cheung Hui2018 · 115 citations
  29. ExT5: Towards Extreme Multi-Task Scaling for Transfer Learning ↗arXiv:2111.10952 · no summary yetVamsi Aribandi et al.2021 · 114 citations
  30. PaLI-X: On Scaling up a Multilingual Vision and Language Model ↗arXiv (Cornell University) · no summary yetChen, Xi et al.2023 · 110 citations
  31. Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers ↗arXiv (Cornell University) · no summary yetYi Tay et al.2021 · 104 citations
  32. Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpoints ↗arXiv:2212.05055 · no summary yetAran Komatsuzaki et al.2022 · 98 citations
  33. Learning Term Embeddings for Taxonomic Relation Identification Using Dynamic Weighting Neural Network ↗Proceedings of the 2016 Conference on Empirical Methods in Natural Language Processing · no summary yetAnh Tuan Luu et al.2016 · 94 citations
  34. Scaling Laws vs Model Architectures: How does Inductive Bias Influence Scaling?Findings of the Association for Computational LinguisticsYi Tay, Mostafa Dehghani, Samira Abnar, et al.2023 · 86 citations
  35. CoLT5: Faster Long-Range Transformers with Conditional ComputationConference on Empirical Methods in Natural Language Processing (EMNLP)Joshua Ainslie, Tao Lei, Michiel de Jong, et al.2023 · 84 citations
  36. Bridging the Gap between Relevance Matching and Semantic Matching for Short Text Similarity Modeling ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetJinfeng Rao et al.2019 · 80 citations
  37. Interact and Decide ↗International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yetLucas Vinh Tran et al.2019 · 79 citations
  38. Lightweight and Efficient Neural Natural Language Processing with Quaternion Networks ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetYi Tay et al.2019 · 76 citations
  39. Symbol tuning improves in-context learning in language models ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetJerry Wei et al.2023 · 68 citations
  40. Inverse Scaling Can Become U-Shaped ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetJason Wei et al.2023 · 62 citations
  41. HyperPrompt: Prompt-based Task-Conditioning of Transformers ↗arXiv (Cornell University) · no summary yetYun He et al.2022 · 62 citations
  42. Densely Connected Attention Propagation for Reading Comprehension ↗arXiv (Cornell University) · no summary yetYi Tay et al.2018 · 62 citations
  43. Multi-Cast Attention Networks ↗ACM SIGKDD International Conference on Knowledge Discovery & Data Mining (KDD) · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2018 · 62 citations
  44. Are Pretrained Convolutions Better than Pretrained Transformers? ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetYi Tay et al.2021 · 61 citations
  45. Sharpness-Aware Minimization Improves Language Model Generalization ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetDara Bahri, Hossein Mobahi, Yi Tay2022 · 60 citations
  46. On Scaling Up a Multilingual Vision and Language Model ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetXi Chen et al.2024 · 59 citations
  47. Hermitian Co-Attention Networks for Text Matching in Asymmetrical Domains ↗International Joint Conference on Artificial Intelligence · no summary yetYi Tay, Anh Tuan Luu, Siu Cheung Hui2018 · 59 citations
  48. Non-Parametric Estimation of Multiple Embeddings for Link Prediction on Dynamic Knowledge Graphs ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYi Tay, Anh Luu, Siu Cheung Hui2017 · 59 citations
  49. Beyond Fully-Connected Layers with Quaternions: Parameterization of Hypercomplex Multiplications with 1/n Parameters ↗arXiv (Cornell University) · no summary yetAston Zhang et al.2021 · 57 citations
  50. Poison Attacks against Text Datasets with Conditional Adversarially Regularized Autoencoder ↗Findings of the Association for Computational Linguistics: EMNLP 2020 · no summary yetAlvin Chan et al.2020 · 57 citations
  51. Are Neural Rankers still Outperformed by Gradient Boosted Decision Trees ↗International Conference on Learning Representations · no summary yetZhen Qin et al.2021 · 56 citations
  52. Robust Representation Learning of Biomedical Names ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetMinh C. Phan, Aixin Sun, Yi Tay2019 · 56 citations
  53. UniMax: Fairer and more Effective Language Sampling for Large-Scale Multilingual Pretraining ↗arXiv (Cornell University) · no summary yetHyung Won Chung et al.2023 · 54 citations
  54. Pair-Linking for Collective Entity Disambiguation: Two Could Be Better Than All ↗IEEE Transactions on Knowledge and Data Engineering · no summary yetMinh C. Phan et al.2018 · 51 citations
  55. The Benchmark Lottery ↗arXiv:2107.07002 · no summary yetMostafa Dehghani et al.2021 · 50 citations
  56. The Efficiency Misnomer ↗arXiv (Cornell University) · no summary yetMostafa Dehghani et al.2021 · 50 citations
  57. Next Item Recommendation with Self-Attention ↗arXiv (Cornell University) · no summary yetShuai Zhang et al.2018 · 50 citations
  58. StructFormer: Joint Unsupervised Induction of Dependency and Constituency Structure from Masked Language Modeling ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetYikang Shen et al.2021 · 48 citations
  59. Co-Stack Residual Affinity Networks with Multi-level Attention Refinement for Matching Text Sequences ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetYi Tay, Anh Tuan Luu, Siu Cheung Hui2018 · 47 citations
  60. Multi-Task Neural Network for Non-discrete Attribute Prediction in Knowledge Graphs ↗arXiv:1708.04828 · no summary yetYi Tay et al.2017 · 47 citations
  61. Cross Temporal Recurrent Networks for Ranking Question Answer Pairs ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2018 · 45 citations
  62. Synthesizer: Rethinking Self-Attention for Transformer Models ↗International Conference on Machine Learning · no summary yetYi Tay et al.2021 · 44 citations
  63. Transcending Scaling Laws with 0.1% Extra ComputearXiv:2210.11399Yi Tay, Jason Wei, Hyung Won Chung, et al.2022 · 42 citations
  64. Are Pre-trained Convolutions Better than Pre-trained Transformers? ↗arXiv (Cornell University) · no summary yetYi Tay et al.2021 · 42 citations
  65. SCENIC: A JAX Library for Computer Vision Research and Beyond ↗arXiv:2110.11403 · no summary yetMostafa Dehghani et al.2021 · 39 citations
  66. Multi-range Reasoning for Machine Comprehension ↗arXiv (Cornell University) · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2018 · 39 citations
  67. What It Thinks Is Important Is Important: Robustness Transfers Through Input Gradients ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetAlvin Chan, Yi Tay, Yew-Soon Ong2020 · 38 citations
  68. DSI++: Updating Transformer Memory with New Documents ↗Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing · no summary yetSanket Vaibhav Mehta et al.2023 · 35 citations
  69. Interact and Decide: Medley of Sub-Attention Networks for Effective Group Recommendation ↗arXiv (Cornell University) · no summary yetLucas Vinh Tran et al.2018 · 33 citations
  70. Improving Compositional Generalization with Self-Training for Data-to-Text Generation ↗Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetSanket Vaibhav Mehta et al.2022 · 32 citations
  71. CoupleNet: Paying Attention to Couples with Coupled Attention for Relationship Recommendation ↗Proceedings of the International AAAI Conference on Web and Social Media · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2018 · 30 citations
  72. Attentive Gated Lexicon Reader with Contrastive Contextual Co-Attention for Sentiment Classification ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetYi Tay et al.2018 · 29 citations
  73. Multi-Cast Attention Networks for Retrieval-based Question Answering and Response Prediction ↗arXiv (Cornell University) · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2018 · 29 citations
  74. Reverse Engineering Configurations of Neural Text Generation Models ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetYi Tay et al.2020 · 28 citations
  75. DeepRec: An Open-source Toolkit for Deep Learning based Recommendation ↗International Joint Conference on Artificial Intelligence · no summary yetShuai Zhang et al.2019 · 28 citations
  76. How Reliable are Model Diagnostics? ↗Findings of the Association for Computational Linguistics: ACL-IJCNLP 2021 · no summary yetVamsi Aribandi, Yi Tay, Donald Metzler2021 · 27 citations
  77. HyperGrid Transformers: Towards A Single Model for Multiple Tasks ↗International Conference on Learning Representations · no summary yetYi Tay et al.2021 · 25 citations
  78. Choppy: Cut Transformer for Ranked List Truncation ↗International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yetDara Bahri et al.2020 · 24 citations
  79. HyperML: A Boosting Metric Learning Approach in Hyperbolic Space for Recommender Systems ↗arXiv (Cornell University) · no summary yetLucas Vinh Tran et al.2018 · 23 citations
  80. Random Semantic Tensor Ensemble for Scalable Knowledge Graph Link Prediction ↗ACM International Conference on Web Search and Data Mining (WSDM) · no summary yetYi Tay et al.2017 · 23 citations
  81. Would you Rather? A New Benchmark for Learning Machine Alignment with Cultural Values and Social Preferences ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetYi Tay et al.2020 · 22 citations
  82. Holistic Multi-Modal Memory Network for Movie Question Answering ↗IEEE Transactions on Image Processing · no summary yetAnran Wang et al.2019 · 22 citations
  83. Interactive Machine Comprehension with Information Seeking Agents ↗Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics · no summary yetXingdi Yuan et al.2020 · 21 citations
  84. Quaternion Collaborative Filtering for Recommendation ↗International Joint Conference on Artificial Intelligence · no summary yetShuai Zhang et al.2019 · 21 citations
  85. Recurrently Controlled Recurrent Networks ↗arXiv (Cornell University) · no summary yetYi Tay, Tuan, Luu Anh, Siu Cheung Hui2018 · 19 citations
  86. Compositional De-Attention Networks ↗neural information processing systems · no summary yetYi Tay et al.2019 · 18 citations
  87. Holographic Factorization Machines for Recommendation ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYi Tay et al.2019 · 18 citations
  88. Deep Learning for Recommender Systems ↗Springer eBooks · no summary yetShuai Zhang et al.2021 · 16 citations
  89. Multi-Granular Sequence Encoding via Dilated Compositional Units for Reading Comprehension ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetYi Tay, Anh Tuan Luu, Siu Cheung Hui2018 · 15 citations
  90. ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference ↗Findings of the Association for Computational Linguistics: ACL 2022 · no summary yetKai Hui et al.2022 · 12 citations
  91. SCARF: Self-Supervised Contrastive Learning using Random Feature Corruption ↗arXiv (Cornell University) · no summary yetDara Bahri et al.2021 · 12 citations
  92. On Orthogonality Constraints for Transformers ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 2: Short Papers) · no summary yetAston Zhang et al.2021 · 11 citations
  93. Generative Models are Unsupervised Predictors of Page Quality: A Colossal-Scale Study ↗ACM International Conference on Web Search and Data Mining (WSDM) · no summary yetDara Bahri et al.2021 · 10 citations
  94. PolyViT: Co-training Vision Transformers on Images, Videos and Audio ↗arXiv (Cornell University) · no summary yetValerii Likhosherstov et al.2021 · 10 citations
  95. HyperGrid: Efficient Multi-Task Transformers with Grid-wise Decomposable Hyper Projections ↗arXiv (Cornell University) · no summary yetYi Tay et al.2020 · 9 citations
  96. HyperQA: Hyperbolic Embeddings for Fast and Efficient Ranking of Question Answer Pairs ↗arXiv (Cornell University) · no summary yetYi Tay, Luu Anh Tuan, Siu Cheung Hui2017 · 9 citations
  97. Knowledge Router: Learning Disentangled Representations for Knowledge Graphs ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetShuai Zhang et al.2021 · 8 citations
  98. Jacobian Adversarially Regularized Networks for Robustness ↗arXiv (Cornell University) · no summary yetAlvin Chan et al.2019 · 8 citations
  99. Cross-Device User Linking ↗International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR) · no summary yetMinh C. Phan, Aixin Sun, Yi Tay2017 · 7 citations
  100. Cross Device Matching for Online Advertising with Neural Feature Ensembles : First Place Solution at CIKM Cup 2016 ↗arXiv (Cornell University) · no summary yetPhan, Minh C., Yi Tay, Tuan-Anh Nguyen Pham2016 · 7 citations

1 2

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/yi-tay/works/