Interspeech 2024: all accepted papers
- XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Model ↗Edresson Casanova, Kelly Davis, Eren Gölge et al.127 citations
- EARS: An Anechoic Fullband Speech Dataset Benchmarked for Speech Enhancement and Dereverberation ↗Julius Richter, Yi-Chiao Wu, Steven Krenn et al.51 citations
- OWSM v3.1: Better and Faster Open Whisper-Style Speech Models based on E-Branchformer ↗Yifan Peng, Jinchuan Tian, William Chen et al.41 citations
- Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection ↗Duc-Tuan Truong, Ruijie Tao, Tuan Lam Nguyen et al.37 citations
- EmoBox: Multilingual Multi-corpus Speech Emotion Recognition Toolkit and Benchmark ↗Ziyang Ma, Mingjie Chen, Hezhao Zhang et al.35 citations
- LoRA-Whisper: Parameter-Efficient and Extensible Multilingual ASR ↗Zheshu Song, Jianheng Zhuo, Yifan Yang et al.33 citations
- Less is More: Accurate Speech Recognition & Translation without Web-Scale Data ↗Krishna C. Puvvada, Piotr Żelasko, He Huang et al.32 citations
- ESPnet-SPK: full pipeline speaker embedding toolkit with reproducible recipes, self-supervised front-ends, and off-the-shelf models ↗Jee-weon Jung, Wangyou Zhang, Jiatong Shi et al.31 citations
- RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection ↗Yujie Chen, Jiangyan Yi, Jun Xue et al.30 citations
- URGENT Challenge: Universality, Robustness, and Generalizability For Speech Enhancement ↗Wangyou Zhang, Robin Scheibler, Kohei Saijo et al.30 citations
- Attentive Merging of Hidden Embeddings from Pre-trained Speech Model for Anti-spoofing Detection ↗Zihan Pan, Tianchi Liu, Hardik B. Sailor et al.29 citations
- Exploiting Foundation Models and Speech Enhancement for Parkinson's Disease Detection from Speech in Real-World Operative Conditions ↗Moreno La Quatra, Maria Francesca Turco, Torbjørn Karl Svendsen et al.28 citations
- Training Data Augmentation for Dysarthric Automatic Speech Recognition by Text-to-Dysarthric-Speech Synthesis ↗Wing-Zin Leung, Mattias Cross, Anton Ragni et al.28 citations
- Whisper-Flamingo: Integrating Visual Features into Whisper for Audio-Visual Speech Recognition and Translation ↗Andrew Rouditchenko, Yuan Gong, Samuel Thomas et al.28 citations
- mHuBERT-147: A Compact Multilingual HuBERT Model ↗Marcely Zanon Boito, Vivek Iyer, Nikolaos Lagos et al.28 citations
- EmoSphere-TTS: Emotional Style and Intensity Modeling via Spherical Emotion Vector for Controllable Emotional Text-to-Speech ↗Deok–Hyeon Cho, Hyung‐Seok Oh, Seung-Bin Kim et al.27 citations
- Exploring the Capability of Mamba in Speech Applications ↗Koichi Miyazaki, Yoshiki Masuyama, Masato Murata27 citations
- Reshape Dimensions Network for Speaker Recognition ↗Ivan Yakovlev, Rostislav Makarov, Andrei Balykin et al.27 citations
- SpeechBERTScore: Reference-Aware Automatic Evaluation of Speech Generation Leveraging NLP Evaluation Metrics ↗Takaaki Saeki, Soumi Maiti, Shinnosuke Takamichi et al.27 citations
- Self-Supervised Speech Representations are More Phonetic than Semantic ↗Kwanghee Choi, Ankita Pasad, Tomohiko Nakamura et al.26 citations
- Genhancer: High-Fidelity Speech Enhancement via Generative Modeling on Discrete Codec Tokens ↗Haici Yang, Jiaqi Su, Minje Kim et al.25 citations
- Universal Score-based Speech Enhancement with High Content Preservation ↗Robin Scheibler, Yusuke Fujita, Yuma Shirahata et al.25 citations
- Connected Speech-Based Cognitive Assessment in Chinese and English ↗Saturnino F. Luz, Sofia de la Fuente García, Fasih Haider et al.24 citations
- DiarizationLM: Speaker Diarization Post-Processing with Large Language Models ↗Quan Wang, Yiling Huang, Guanlong Zhao et al.23 citations
- Source Tracing of Audio Deepfake Systems ↗Nicholas Klein, Tianxiang Chen, Hemlata Tak et al.23 citations
- Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations ↗Sarthak Yadav, Zheng‐Hua Tan22 citations
- CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems ↗Haibin Wu, Yuan Tseng, Hung-yi Lee22 citations
- PAM: Prompting Audio-Language Models for Audio Quality Assessment ↗Soham Deshmukh, Dareen Alharthi, Benjamin Elizalde et al.22 citations
- Schrödinger Bridge for Generative Speech Enhancement ↗Ante Jukić, Roman Korostik, Jagadeesh Balam et al.22 citations
- Noise-aware Speech Enhancement using Diffusion Probabilistic Model ↗Yu‐Chen Hu, Chen Chen, Ruizhe Li et al.21 citations
- Scaling up masked audio encoder learning for general audio classification ↗Heinrich Dinkel, Zhiyong Yan, Yongqing Wang et al.21 citations
- Single-Codec: Single-Codebook Speech Codec towards High-Performance Speech Generation ↗Hanzhao Li, Liumeng Xue, Haohan Guo et al.21 citations
- BTS: Bridging Text and Sound Modalities for Metadata-Aided Respiratory Sound Classification ↗June-Woo Kim, Miika Toikkanen, Yera Choi et al.20 citations
- EEND-M2F: Masked-attention mask transformers for speaker diarization ↗Marc Härkönen, Samuel J. Broughton, Lahiru Samarakoon20 citations
- ERes2NetV2: Boosting Short-Duration Speaker Verification Performance with Computational Efficiency ↗Yafeng Chen, Siqi Zheng, Hui Wang et al.20 citations
- NOTSOFAR-1 Challenge: New Datasets, Baseline, and Tasks for Distant Meeting Transcription ↗Alon Vinnikov, Amir Ivry, Aviv Hurvitz et al.20 citations
- SilentCipher: Deep Audio Watermarking ↗Mayank Singh, Naoya Takahashi, Weihsiang Liao et al.19 citations
- AnoPatch: Towards Better Consistency in Machine Anomalous Sound Detection ↗Anbai Jiang, Bing Han, Zhiqiang Lv et al.18 citations
- Controlling Emotion in Text-to-Speech with Natural Language Prompts ↗Thomas Bott, Florian Lux, Ngoc Thang Vu18 citations
- MUSE: Flexible Voiceprint Receptive Fields and Multi-Path Fusion Enhanced Taylor Transformer for U-Net-based Speech Enhancement ↗Zizhen Lin, X. Chen, Junyu Wang18 citations
- MultiTalk: Enhancing 3D Talking Head Generation Across Languages with Multilingual Video Dataset ↗Sung-Bin Kim, Lee Chae-Yeon, Gihun Son et al.18 citations
- The Interspeech 2024 Challenge on Speech Processing Using Discrete Units ↗Xuankai Chang, Jiatong Shi, Jinchuan Tian et al.18 citations
- CrisperWhisper: Accurate Timestamps on Verbatim Speech Transcriptions ↗Mario Zusag, Laurin Wagner, Bernhad Thallinger17 citations
- Fine-Tuning Automatic Speech Recognition for People with Parkinson's: An Effective Strategy for Enhancing Speech Technology Accessibility ↗Xiuwen Zheng, Bornali Phukon, Mark Hasegawa‐Johnson17 citations
- WenetSpeech4TTS: A 12,800-hour Mandarin TTS Corpus for Large Speech Generation Model Benchmark ↗Linhan Ma, Dake Guo, Kun Song et al.17 citations
- AS-70: A Mandarin stuttered speech dataset for automatic speech recognition and stuttering event detection ↗Rong Gong, Hongfei Xue, Lezhi Wang et al.16 citations
- CtrSVDD: A Benchmark Dataset and Baseline Analysis for Controlled Singing Voice Deepfake Detection ↗Yongyi Zang, Jiatong Shi, You Zhang et al.16 citations
- DNSMOS Pro: A Reduced-Size DNN for Probabilistic MOS of Speech ↗Fredrik Cumlin, Xinyu Liang, Victor Ungureanu et al.16 citations
- DeSTA: Enhancing Speech Language Models through Descriptive Speech-Text Alignment ↗Ke-Han Lu, Zhehuai Chen, Szu‐Wei Fu et al.16 citations
- How Do Neural Spoofing Countermeasures Detect Partially Spoofed Audio? ↗Tianchi Liu, Lin Zhang, Rohan Kumar Das et al.16 citations
- MaLa-ASR: Multimedia-Assisted LLM-Based ASR ↗Guanrou Yang, Ziyang Ma, Fan Yu et al.16 citations
- SimpleSpeech: Towards Simple and Efficient Text-to-Speech with Scalar Latent Transformer Diffusion Models ↗Dongchao Yang, Dingdong Wang, Haohan Guo et al.16 citations
- Enhancing Partially Spoofed Audio Localization with Boundary-aware Attention Mechanism ↗Jiafeng Zhong, Bin Li, Jiangyan Yi15 citations
- Inclusive ASR for Disfluent Speech: Cascaded Large-Scale Self-Supervised Learning with Targeted Fine-Tuning and Data Augmentation ↗Dena F. Mujtaba, Nihar R. Mahapatra, Megan Arney et al.15 citations
- SyncVSR: Data-Efficient Visual Speech Recognition with End-to-End Crossmodal Audio Token Synchronization ↗Young Jin Ahn, Jung‐Woo Park, Sangha Park et al.15 citations
- Towards generalisable and calibrated audio deepfake detection with self-supervised representations ↗Octavian Pascu, Adriana Stan, Dan Oneaţă et al.15 citations
- VoxBlink2: A 100K+ Speaker Recognition Corpus and the Open-Set Speaker-Identification Benchmark ↗Yuke Lin, Ming Cheng, Fulin Zhang et al.15 citations
- Benchmarking Children's ASR with Supervised and Self-supervised Speech Foundation Models ↗Ruchao Fan, Natarajan Balaji Shankar, Abeer A. Alwan14 citations
- Exploring Self-supervised Embeddings and Synthetic Data Augmentation for Robust Audio Deepfake Detection ↗Juan M. Martín-Doñas, Aitor Álvarez, Eros Roselló et al.14 citations
- FakeSound: Deepfake General Audio Detection ↗Zeyu Xie, Baihan Li, Xuenan Xu et al.14 citations
- Investigating ASR Error Correction with Large Language Model and Multilingual 1-best Hypotheses ↗Sheng Li, Chen Chen, Chin Yuen Kwok et al.14 citations
- Speech Emotion Recognition with Multi-level Acoustic and Semantic Information Extraction and Interaction ↗Yuan Gao, Hao Shi, Chenhui Chu et al.14 citations
- The PESQetarian: On the Relevance of Goodhart's Law for Speech Enhancement ↗Danilo de Oliveira, Simon Welker, Julius Richter et al.14 citations
- Harder or Different? Understanding Generalization of Audio Deepfake Detection ↗Nicolas M. Müller, Nicholas Evans, Hemlata Tak et al.13 citations
- HuBERT-EE: Early Exiting HuBERT for Efficient Speech Recognition ↗Ji Won Yoon, Beom Jun Woo, Nam Soo Kim13 citations
- Macro-descriptors for Alzheimer's disease detection using large language models ↗Catarina Botelho, John Mendonça, Anna Pompili et al.13 citations
- MaskSR: Masked Language Model for Full-band Speech Restoration ↗Xu Li, Qirui Wang, Xiaoyu Liu13 citations
- One-class learning with adaptive centroid shift for audio deepfake detection ↗Hyun Myung Kim, Kangwook Jang, Hoirin Kim13 citations
- Clever Hans Effect Found in Automatic Detection of Alzheimer's Disease through Speech ↗Yin-Long Liu, Rui Feng, Jiahong Yuan et al.12 citations
- Dynamic Gated Recurrent Neural Network for Compute-efficient Speech Enhancement ↗Longbiao Cheng, Ashutosh Pandey, Buye Xu et al.12 citations
- Dysarthric Speech Recognition Using Curriculum Learning and Articulatory Feature Embedding ↗I-Ting Hsieh, Chung‐Hsien Wu12 citations
- Empowering Whisper as a Joint Multi-Talker and Target-Talker Speech Recognition System ↗Lingwei Meng, Jiawen Kang, Yuejiao Wang et al.12 citations
- ExHuBERT: Enhancing HuBERT Through Block Extension and Fine-Tuning on 37 Emotion Datasets ↗Shahin Amiriparian, Filip Packań, Maurice Gerczuk et al.12 citations
- Fine-tune Pre-Trained Models with Multi-Level Feature Fusion for Speaker Verification ↗Shengyu Peng, Wu Guo, Haochen Wu et al.12 citations
- FlowAVSE: Efficient Audio-Visual Speech Enhancement with Conditional Flow Matching ↗Chaeyoung Jung, Su‐Yeon Lee, Ji-Hoon Kim et al.12 citations
- Investigation of Layer-Wise Speech Representations in Self-Supervised Learning Models: A Cross-Lingual Study in Detecting Depression ↗Bubai Maji, Rajlakshmi Guha, Aurobinda Routray et al.12 citations
- LAFMA: A Latent Flow Matching Model for Text-to-Audio Generation ↗Wenhao Guan, Kaidi Wang, Wangjin Zhou et al.12 citations
- Large Language Models for Dysfluency Detection in Stuttered Speech ↗Dominik Wagner, Sebastian Peter Bayerl, Ilja Baumann et al.12 citations
- Multilingual Speech and Language Analysis for the Assessment of Mild Cognitive Impairment: Outcomes from the Taukadial Challenge ↗Paula Andrea Pérez-Toro, Tomás Arias‐Vergara, Philipp Klumpp et al.12 citations
- TraceableSpeech: Towards Proactively Traceable Text-to-Speech with Watermarking ↗Junzuo Zhou, Jiangyan Yi, Tao Wang et al.12 citations
- Tradition or Innovation: A Comparison of Modern ASR Methods for Forced Alignment ↗Rotem Rousso, Eyal Cohen, Joseph Keshet et al.12 citations
- Beyond Performance Plateaus: A Comprehensive Study on Scalability in Speech Enhancement ↗Wangyou Zhang, Kohei Saijo, Jee-weon Jung et al.11 citations
- COSMIC: Data Efficient Instruction-tuning For Speech In-Context Learning ↗Jing Samantha Pan, Jian Wu, Yashesh Gaur et al.11 citations
- Emo-bias: A Large Scale Evaluation of Social Bias on Speech Emotion Recognition ↗Yi‐Cheng Lin, Haibin Wu, Huang-Cheng Chou et al.11 citations
- Improving Neural Biasing for Contextual Speech Recognition by Early Context Injection and Text Perturbation ↗Ruizhe Huang, Mahsa Yarmohammadi, Sanjeev P. Khudanpur et al.11 citations
- MM-KWS: Multi-modal Prompts for Multilingual User-defined Keyword Spotting ↗Zhiqi Ai, Zhiyong Chen, Shugong Xu11 citations
- Singing Voice Graph Modeling for SingFake Detection ↗Xuanjun Chen, Haibin Wu, Roger Jang et al.11 citations
- Spoofed Speech Detection with a Focus on Speaker Embedding ↗Hoan My Tran, David Guennec, Philippe Martin et al.11 citations
- Towards Rehearsal-Free Multilingual ASR: A LoRA-based Case Study on Whisper ↗Tianyi Xu, Kaixun Huang, Pengcheng Guo et al.11 citations
- Towards Supervised Performance on Speaker Verification with Self-Supervised Learning by Leveraging Large-Scale ASR Models ↗Victor Miara, Théo Lepage, Réda Dehak11 citations
- Voice Disorder Analysis: a Transformer-based Approach ↗Alkis Koudounas, Gabriele Ciravegna, Marco Fantini et al.11 citations
- WeSep: A Scalable and Flexible Toolkit Towards Generalizable Target Speaker Extraction ↗Shuai Wang, Ke Zhang, Shaoxiong Lin et al.11 citations
- Asynchronous Voice Anonymization Using Adversarial Perturbation On Speaker Embedding ↗Rui Wang, Liping Chen, Kong Aik Lee et al.10 citations
- From Text to Emotion: Unveiling the Emotion Annotation Capabilities of LLMs ↗Minxue Niu, Mimansa Jaiswal, Emily Mower Provost10 citations
- Global-Local Convolution with Spiking Neural Networks for Energy-efficient Keyword Spotting ↗Shuai Wang, Dehao Zhang, Kexin Shi et al.10 citations
- Improving Domain-Specific ASR with LLM-Generated Contextual Descriptions ↗Ji-Won Suh, Injae Na, Woohwan Jung10 citations
- LibriTTS-P: A Corpus with Speaking Style and Speaker Identity Prompts for Text-to-Speech and Style Captioning ↗Masaya Kawamura, Ryuichi Yamamoto, Yuma Shirahata et al.10 citations
- M2D-CLAP: Masked Modeling Duo Meets CLAP for Learning General-purpose Audio-Language Representation ↗Daisuke Niizumi, Daiki Takeuchi, Yasunori Ohishi et al.10 citations
- MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detection ↗Pengfei Cai, Yan Song, Kang Li et al.10 citations
- MFF-EINV2: Multi-scale Feature Fusion across Spectral-Spatial-Temporal Domains for Sound Event Localization and Detection ↗Da Mu, Zhicheng Zhang, Haobo Yue10 citations
This page in Markdown → https://md.research.elamur.ai/free/en/venues/interspeech-usb/2024/papers/