Qingyu Tan
Qingyu Tan has 4 papers in our library, in 2021–2023, most of them on Language models & pretraining, Information extraction, Efficient models & compression; often with Lidong Bing, Hwee Tou Ng, Liying Cheng.
OpenAlex · h-index 7 · 12 works · 456 citations OpenAlex, 2026-10-14
📄 4 works in our library · 🔗 Cited 267 times in our library · ⭐ Paper Stars ranking: #3007
Affiliations
Concepts, shelves and topics
📚 Shelves 5The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 4 worksComputer Science · 4 worksArtificial Intelligence · 4 worksLanguage and Linguistics · 4 worksComputer Vision and Pattern Recognition · 2 works
🧭 Topics 3Research subjects and languages the work is about.Language models & pretraining · 2 worksInformation extraction · 2 worksEfficient models & compression · 1 work
Works by year
2020s
Papers
- On the Effectiveness of Adapter-based Tuning for Pretrained Language Model Adaptation (2021 · 204 citations)
Adapter-based tuning inserts small trainable modules into a frozen pretrained language model (PrLM). Earlier work valued it mainly for saving parameters. This paper asks a different question: when does it actually beat full fine-tuning? The authors use the Houlsby et al. adapter design. Each transformer layer gets… - Document-Level Relation Extraction with Adaptive Focal Loss and Knowledge Distillation (2022 · 169 citations)
The paper addresses document-level relation extraction (DocRE), where relations must be identified between every ordered pair of given entities across a whole document. - Revisiting DocRED - Addressing the False Negative Problem in Relation Extraction (2022 · 151 citations)
DocRED is a standard benchmark for document-level relation extraction. It was built by having annotators filter candidate triples suggested by Wikidata distant supervision and an early RE model. The authors show that this process left many true relations unlabeled, so false negatives are widespread. They trace the… - SeaLLMs — Large Language Models for Southeast Asia (2023 · 92 citations)
Mainstream LLMs are trained mostly on English. As a result, they handle Southeast Asian languages poorly, especially those written in non-Latin scripts, which standard BPE tokenizers break into very long token sequences. SeaLLMs are open models for Southeast Asian languages, built by adapting English-centric…
Co-authors here
- Lidong Bing ×3
- Hwee Tou Ng ×2
- Liying Cheng ×2
- Ruidan He ×2
- Bosheng Ding
- Chenhui Shen
- Guanzheng Chen
- Jianyu Wang
- Linlin Liu
- Lu Xu
- Luo Si
- Wenxuan Zhang
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2021
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2022
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2022
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/qingyu-tan/