🧑‍🔬 Louis-Philippe Morency — all works

91 works · ← Louis-Philippe Morency

1. Multimodal Transformer for Unaligned Multimodal Language SequencesAnnual Meeting of the Association for Computational Linguistics (ACL)Yao-Hung Hubert Tsai, Shaojie Bai, Paul Pu Liang, et al.2019 · 2,193 citations
2. Tensor Fusion Network for Multimodal Sentiment AnalysisConference on Empirical Methods in Natural Language Processing (EMNLP)Amir Zadeh, Minghai Chen, Soujanya Poria, et al.2017 · 2,125 citations
3. Multimodal Language Analysis in the Wild: CMU-MOSEI Dataset and Interpretable Dynamic Fusion GraphAnnual Meeting of the Association for Computational Linguistics (ACL)AmirAli Bagher Zadeh, Paul Pu Liang, Soujanya Poria, et al.2018 · 1,522 citations
4. Efficient Low-rank Multimodal Fusion With Modality-Specific FactorsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhun Liu, Ying Shen, Varun Bharadhwaj Lakshminarasimhan, et al.2018 · 1,188 citations
5. Context-Dependent Sentiment Analysis in User-Generated VideosAnnual Meeting of the Association for Computational Linguistics (ACL)Soujanya Poria, Erik Cambria, Devamanyu Hazarika, et al.2017 · 1,029 citations
6. Integrating Multimodal Information in Large Pretrained TransformersAnnual Meeting of the Association for Computational Linguistics (ACL)Wasifur Rahman, Md Kamrul Hasan, Sangwu Lee, et al.2020 · 746 citations
7. Conversational Memory Network for Emotion Recognition in Dyadic Dialogue VideosConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Devamanyu Hazarika, Soujanya Poria, Amir Zadeh, et al.2018 · 543 citations
8. Found in Translation: Learning Robust Joint Representations by Cyclic Translations between Modalities ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetHai Pham et al.2019 · 533 citations
9. Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetYansen Wang et al.2019 · 513 citations
10. Hidden Conditional Random Fields ↗IEEE Transactions on Pattern Analysis and Machine Intelligence · no summary yetAriadna Quattoni et al.2007 · 502 citations
11. Hidden Conditional Random Fields for Gesture Recognition ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetSy Bor Wang et al.2006 · 451 citations
12. Latent-Dynamic Discriminative Models for Continuous Gesture Recognition ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetLouis‐Philippe Morency, Ariadna Quattoni, Trevor Jackson Darrell2007 · 391 citations
13. Speaker-Follower Models for Vision-and-Language Navigation ↗arXiv:1806.02724 · no summary yetDaniel Fried et al.2018 · 343 citations
14. Learning Factorized Multimodal Representations ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2018 · 286 citations
15. Towards Understanding and Mitigating Social Biases in Language ModelsarXiv:2106.13219Paul Pu Liang, Chiyu Wu, Louis-Philippe Morency, et al.2021 · 271 citations
16. Towards Debiasing Sentence RepresentationsAnnual Meeting of the Association for Computational Linguistics (ACL)Paul Pu Liang, Irene Mengze Li, Emily Zheng, et al.2020 · 262 citations
17. Multimodal Language Analysis with Recurrent Multistage Fusion ↗Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing · no summary yetPaul Pu Liang et al.2018 · 248 citations
18. UR-FUNNY: A Multimodal Language Dataset for Understanding Humor ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetMd Kamrul Hasan et al.2019 · 213 citations
19. Affect-LM: A Neural Language Model for Customizable Affective Text Generation ↗Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetSayan Ghosh et al.2017 · 206 citations
20. Transformer Dissection: An Unified Understanding for Transformer's Attention via the Lens of Kernel ↗Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) · no summary yetYao-Hung Hubert Tsai et al.2019 · 194 citations
21. Investigating voice quality as a speaker-independent indicator of depression and PTSD ↗Interspeech (USB) · no summary yetStefan J. Scherer et al.2013 · 141 citations
22. Think Locally, Act Globally: Federated Learning with Local and Global Representations ↗arXiv (Cornell University) · no summary yetPaul Pu Liang et al.2020 · 140 citations
23. SOTOPIA: Interactive Evaluation for Social Intelligence in Language AgentsarXiv:2310.11667Xuhui Zhou, Hao Zhu, Leena Mathur, et al.2023 · 138 citations
24. Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetAmir Zadeh et al.2019 · 133 citations
25. Contextual recognition of head gestures ↗International Conference on Multimodal Interfaces · no summary yetLouis‐Philippe Morency et al.2005 · 132 citations
26. Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization ↗Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics · no summary yetPaul Pu Liang et al.2019 · 109 citations
27. Adaptive view-based appearance models ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetLouis‐Philippe Morency, Ali Rahimi, Trevor Jackson Darrell107 citations
28. MTAG: Modal-Temporal Attention Graph for Unaligned Human Multimodal Language Sequences ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetJianing Yang et al.2021 · 106 citations
29. Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis ↗Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) · no summary yetYao-Hung Hubert Tsai et al.2020 · 106 citations
30. Action Recognition by Hierarchical Sequence Summarization ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYale Song, Louis‐Philippe Morency, Randall Davis2013 · 101 citations
31. Video Relationship Reasoning Using Gated Spatio-Temporal Energy Graph ↗IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · no summary yetYao-Hung Hubert Tsai et al.2019 · 98 citations
32. Humor Knowledge Enriched Transformer for Understanding Multimodal Humor ↗Proceedings of the AAAI Conference on Artificial Intelligence · no summary yetMd Kamrul Hasan et al.2021 · 85 citations
33. Recognizing gaze aversion gestures in embodied conversational discourse ↗International Conference on Multimodal Interfaces · no summary yetLouis‐Philippe Morency, C. Mario Christoudias, Trevor Jackson Darrell2006 · 85 citations
34. Uncertainty Quantification with Pre-trained Language Models: A Large-Scale Empirical Analysis ↗Findings of the Association for Computational Linguistics: EMNLP 2022 · no summary yetYuxin Xiao et al.2022 · 79 citations
35. Combating Human Trafficking with Multimodal Deep Models ↗Proceedings of the 55th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetEdmund Tong et al.2017 · 75 citations
36. Head gesture recognition in intelligent interfaces ↗ACM International Conference on Intelligent User Interfaces (IUI) · no summary yetLouis‐Philippe Morency, Trevor Jackson Darrell2006 · 72 citations
37. Pose estimation using 3D view-based eigenspaces ↗Proceedings - IEEE International SOI Conference/Proceedings · no summary yetLouis‐Philippe Morency, Patrik Sundberg, Trevor Jackson Darrell2003 · 68 citations
38. No Gestures Left Behind: Learning Relationships between Spoken Language and Freeform Gestures ↗Findings of the Association for Computational Linguistics: EMNLP 2020 · no summary yetChaitanya Ahuja et al.2020 · 65 citations
39. Fast stereo-based head tracking for interactive environments ↗no summary yetLouis‐Philippe Morency et al.2002 · 65 citations
40. Evaluating look-to-talk ↗CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · no summary yetAlice H. Oh et al.2002 · 56 citations
41. StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer ↗Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies · no summary yetYiwei Lyu et al.2021 · 50 citations
42. Think Twice: Perspective-Taking Improves Large Language Models' Theory-of-Mind CapabilitiesAnnual Meeting of the Association for Computational Linguistics (ACL)Alex Wilf, Sihyun Lee, Paul Pu Liang, et al.2024 · 48 citations
43. DIME: Fine-grained Interpretations of Multimodal Models via Disentangled Local Explanations ↗Proceedings of the AAAI/ACM Conference on AI Ethics and Society · no summary yetYiwei Lyu et al.2022 · 42 citations
44. MultiBench: Multiscale Benchmarks for Multimodal Representation Learning ↗PubMed · no summary yetPaul Pu Liang et al.2021 · 42 citations
45. Deep Gamblers: Learning to Abstain with Portfolio Theory ↗arXiv (Cornell University) · no summary yetLiu Ziyin et al.2019 · 41 citations
46. Stereo tracking using ICP and normal flow constraint ↗no summary yetLouis‐Philippe Morency, Trevor Jackson Darrell2002 · 41 citations
47. Strong and Simple Baselines for Multimodal Utterance Embeddings ↗Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers) · no summary yetPaul Pu Liang et al.2019 · 36 citations
48. Factorized Contrastive Learning: Going Beyond Multi-view Redundancy ↗neural information processing systems · no summary yetPaul Pu Liang et al.2023 · 32 citations
49. Co-Adaptation of audio-visual speech and gesture classifiers ↗International Conference on Multimodal Interfaces · no summary yetC. Mario Christoudias et al.2006 · 32 citations
50. A multi-modal approach for determining speaker location and focus ↗International Conference on Multimodal Interfaces · no summary yetMichael R. Siracusa et al.2003 · 31 citations
51. Cross-Modal Generalization: Learning in Low Resource Modalities via Meta-Alignment ↗ACM International Conference on Multimedia (ACM MM) · no summary yetPaul Pu Liang et al.2021 · 25 citations
52. MMoE: Enhancing Multimodal Models with Mixtures of Multimodal Interaction Experts ↗Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · no summary yetHaofei Yu et al.2024 · 22 citations
53. MultiViz: Towards Visualizing and Understanding Multimodal Models ↗arXiv (Cornell University) · no summary yetPaul Pu Liang et al.2022 · 21 citations
54. Demystifying Self-Supervised Learning: An Information-Theoretical Framework. ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2020 · 18 citations
55. Learning Not to Learn in the Presence of Noisy Labels ↗arXiv (Cornell University) · no summary yetLiu Ziyin et al.2020 · 18 citations
56. Nodding in conversations with a robot ↗CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · no summary yetChristopher William Lee et al.2004 · 18 citations
57. PACS: A Dataset for Physical Audiovisual CommonSense Reasoning ↗Lecture notes in computer science · no summary yetSamuel Yu et al.2022 · 17 citations
58. Reducing drift in differential tracking ↗Computer Vision and Image Understanding · no summary yetAli Rahimi, Louis‐Philippe Morency, Trevor Jackson Darrell2006 · 17 citations
59. Conditional Contrastive Learning for Improving Fairness in Self-Supervised Learning ↗arXiv (Cornell University) · no summary yetMartin Q. Ma et al.2021 · 14 citations
60. A Note on Connecting Barlow Twins with Negative-Sample-Free Contrastive Learning ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2021 · 14 citations
61. High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-Modality Representation Learning ↗arXiv (Cornell University) · no summary yetPaul Pu Liang et al.2022 · 13 citations
62. From conversational tooltips to grounded discourse ↗International Conference on Multimodal Interfaces · no summary yetLouis‐Philippe Morency, Trevor Jackson Darrell2004 · 13 citations
63. Fast 3D model acquisition from stereo images ↗International Symposium on 3D Data Processing, Visualization and Transmission · no summary yetLouis‐Philippe Morency, Ali Rahimi, Trevor Jackson Darrell2002 · 13 citations
64. Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data ↗Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers) · no summary yetPaul Pu Liang et al.2021 · 12 citations
65. Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetRohan Pandey et al.2023 · 11 citations
66. Conditional Contrastive Learning with Kernel ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2022 · 10 citations
67. Neural Methods for Point-wise Dependency Estimation ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2020 · 10 citations
68. Multimodal Fusion Interactions: A Study of Human and Automatic Quantification ↗INTERNATIONAL CONFERENCE ON MULTIMODAL INTERACTION · no summary yetPaul Pu Liang et al.2023 · 9 citations
69. Conditional Sequence Model for Context-Based Recognition of Gaze Aversion ↗Springer eBooks · no summary yetLouis‐Philippe Morency, Trevor Jackson Darrell2008 · 9 citations
70. Light Field Appearance Manifolds ↗Lecture notes in computer science · no summary yetC. Mario Christoudias, Louis‐Philippe Morency, Trevor Jackson Darrell2004 · 9 citations
71. HEMM: Holistic Evaluation of Multimodal Foundation Models ↗neural information processing systems · no summary yetPaul Pu Liang et al.2024 · 8 citations
72. Self-supervised Representation Learning with Relative Predictive Coding ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2021 · 8 citations
73. Unsupervised Domain Adaptation for Visual Navigation ↗arXiv (Cornell University) · no summary yetShangda Li et al.2020 · 7 citations
74. On Emergent Communication in Competitive Multi-Agent Teams ↗Adaptive Agents and Multi-Agents Systems · no summary yetPaul Pu Liang et al.2020 · 7 citations
75. Understanding the Tradeoffs in Client-side Privacy for Downstream Speech Tasks ↗arXiv (Cornell University) · no summary yetPeter Wu et al.2021 · 6 citations
76. Dialogue Act Recognition using Reweighted Speaker AdaptationAnnual Meeting of the Special Interest Group on Discourse and Dialogue (SIGDIAL)Congkai Sun, Louis-Philippe Morency2012 · 6 citations
77. Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control ↗Findings of the Association for Computational Linguistics: ACL 2023 · no summary yetXiang Fan et al.2023 · 5 citations
78. Integrating Auxiliary Information in Self-supervised Learning ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2021 · 5 citations
79. Towards Context-Based Visual Feedback Recognition for Embodied Agents ↗no summary yetLouis‐Philippe Morency, Candace L. Sidner, Trevor Jackson Darrell2005 · 5 citations
80. Multimodal Learning Without Labeled Multimodal Data: Guarantees and Applications ↗arXiv (Cornell University) · no summary yetPaul Pu Liang et al.2023 · 4 citations
81. MultiViz: Towards User-Centric Visualizations and Interpretations of Multimodal Models ↗Extended Abstracts of the CHI Conference on Human Factors in Computing Systems (CHI EA) · no summary yetPaul Pu Liang et al.2023 · 3 citations
82. A Simple Approach to the Noisy Label Problem Through the Gambler's Loss ↗no summary yetLiu Ziyin et al.2019 · 3 citations
83. Hidden-state conditional random fields ↗no summary yetAriadna Quattoni et al.2007 · 3 citations
84. Global Reward to Local Rewards: Multimodal-Guided Decomposition for Improving Dialogue Agents ↗Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing · no summary yetDong Won Lee et al.2024 · 2 citations
85. Learning Weakly-Supervised Contrastive Representations ↗arXiv (Cornell University) · no summary yetYao-Hung Hubert Tsai et al.2022 · 2 citations
86. Non-parametric and light-field deformable models ↗Computer Vision and Image Understanding · no summary yetC. Mario Christoudias, Louis‐Philippe Morency, Trevor Jackson Darrell2006 · 2 citations
87. Improving Dialogue Agents by Decomposing One Global Explicit Annotation with Local Implicit Multimodal Feedback ↗arXiv (Cornell University) · no summary yetDong Won Lee et al.2024 · 1 citation
88. MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning ↗arXiv (Cornell University) · no summary yetPaul Pu Liang et al.2023 · 1 citation
89. Evaluating Look-to-Talk: A Gaze-Aware Interface in a Collaborative Environment ↗no summary yetAlice Oh et al.2002 · 1 citation
90. Act2See: Emergent Active Visual Perception for Video Reasoning ↗arXiv (Cornell University) · no summary yetMartin Q. Ma et al.2026
91. Video Active Perception: Effective Inference-Time Long-Form Video Understanding with Vision-Language Models ↗arXiv (Cornell University) · no summary yetMartin Q. Ma et al.2026

↑ back to top

This page in Markdown → https://md.research.elamur.ai/free/en/authors/louis-philippe-morency/works/