Yingxia Shao
Yingxia Shao has 2 papers in our library, in 2022–2024, most of them on Language models & pretraining, Information retrieval & search; often with Shitao Xiao, Zheng Liu, Defu Lian.
OpenAlex · ORCID · Wikidata · h-index 30 · 167 works · 2,696 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 158 times in our library · 2 more in our library without a page yet · ⭐ Paper Stars ranking: #6419
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Vision and Pattern Recognition · 2 worksLanguage and Linguistics · 2 worksInformation Systems · 1 work
🧭 Topics 2Research subjects and languages the work is about.Information retrieval & search · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-Encoder (2022 · 145 citations)
Standard language models such as BERT learn mainly through token-level objectives. These objectives do little to build strong whole-sentence embeddings, which limits the models as encoders for dense retrieval. Contrastive pre-training could help, but it depends on good data augmentation and on many negatives.… - Making Text Embedders Few-Shot Learners (2024 · 60 citations)
LLM-based text embedders perform well on tasks they were trained on, but they often fail to follow unfamiliar instructions or handle complex retrieval, because training covers only a narrow range of instructions.
All works
- RetroMAE: Pre-Training Retrieval-oriented Language Models Via Masked Auto-EncoderConference on Empirical Methods in Natural Language Processing (EMNLP)Shitao Xiao, Zheng Liu, Yingxia Shao, et al.2022 · 145 citations
- Distributed Graph Neural Network Training: A Survey ↗arXiv:2211.00216 · no summary yetYingxia Shao et al.2022 · 103 citations
- Causal Intervention and Counterfactual Reasoning for Multi-modal Fake News Detection ↗Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) · no summary yetZiwei Chen et al.2023 · 72 citations
- Making Text Embedders Few-Shot LearnersarXiv:2409.15700Chaofan Li, MingHao Qin, Shitao Xiao, et al.2024 · 60 citations
Co-authors here
Venues
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2022
- Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/yingxia-shao/