Shimin Li
Shimin Li has 2 papers in our library, in 2023, most of them on Language models & pretraining, Dialogue systems, Speech & spoken language; often with Dong Zhang, Xin Zhang, Xipeng Qiu.
No OpenAlex profile matched yet.
2 works in our library · 198 citations in our library · ⭐ Paper Star rank #3243
Topics
Language models & pretraining2 Dialogue systems1 Speech & spoken language1 Tokenization & segmentation1
Works by year
2020s
Papers
- SpeechGPT: Empowering Large Language Models with Intrinsic Cross-Modal Conversational Abilities (2023 · 346 citations)
Most systems that let large language models talk chain separate ASR and TTS modules around a text LLM. This design keeps the LLM's knowledge from reaching the speech modality, discards cues such as emotion and prosody, and lets errors pile up between stages. SpeechGPT addresses this by converting speech into discrete… - SpeechTokenizer: Unified Speech Tokenizer for Speech Large Language Models (2023 · 51 citations)
Speech large language models rely on discrete tokens of two kinds. Semantic tokens, such as k-means units from HuBERT, follow linguistic content but discard voice traits. Acoustic tokens from neural codecs like EnCodec retain audio detail but correspond poorly to text. The authors first build SLMTokBench, a benchmark…
Co-authors here
- Dong Zhang ×2
- Xin Zhang ×2
- Xipeng Qiu ×2
- Yaqian Zhou ×2
- Jun Zhan
Cited by
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shimin-li/