Shiyu Huang
Shiyu Huang has 3 papers in our library, in 2023–2024, most of them on Language models & pretraining, Vision & language; often with Ming Ding, Wenyi Hong, Zhuoyi Yang.
OpenAlex · h-index 3 · 4 works · 46 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 254 times in our library · ⭐ Paper Stars ranking: #4095
Concepts, shelves and topics
📚 Shelves 4The field of science this work belongs to (OpenAlex fields).Computer Science · 3 worksComputer Vision and Pattern Recognition · 2 worksArtificial Intelligence · 1 workComputer Graphics and Computer-Aided Design · 1 work
🧭 Topics 2Research subjects and languages the work is about.Language models & pretraining · 1 workVision & language · 1 work
Works by year
2020s
Papers
- CogVideoX: Text-to-Video Diffusion Models with An Expert Transformer (2024 · 163 citations)
CogVideoX addresses a persistent weakness of text-to-video systems: clips that are short, nearly static, and poorly matched to prompts describing a sequence of events. The authors build a diffusion transformer around four main components: - SwiftSage: A Generative Agent with Fast and Slow Thinking for Complex Interactive Tasks (2023 · 105 citations)
Agents in text-based simulated environments struggle with long, multi-step tasks. They must plan over many steps, remember context, break goals into subgoals and recover when something goes wrong. Imitation-trained models pick up action patterns well but plan and recover poorly. Prompted LLMs plan well but have… - CogVLM2: Visual Language Models for Image and Video Understanding (2024 · 52 citations)
Text-only LLMs cannot use visual input. Existing vision-language models often have three weaknesses: they connect image features to the LLM only superficially, high-resolution inputs make them expensive, and they lose track of timing in videos.
Co-authors here
- Ming Ding ×2
- Wenyi Hong ×2
- Zhuoyi Yang ×2
- Bill Yuchen Lin
- Chandra Bhagavatula
- Da Yin
- Faeze Brahman
- Guanyu Feng
- Jiazheng Xu
- Junhui Ji
- Lei Zhao
- Prithviraj Ammanabrolu
Venues
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shiyu-huang/