Shengyu Fu
Shengyu Fu has 2 papers in our library, in 2021–2023, most of them on Language models & pretraining, Code & programming languages; often with Alexey Svyatkovskiy, Nan Duan, Shuai Lu.
OpenAlex · ORCID · h-index 10 · 30 works · 1,442 citations OpenAlex, 2026-10-14
📄 2 works in our library · 🔗 Cited 181 times in our library · ⭐ Paper Stars ranking: #5187
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 2 worksComputer Science · 2 worksArtificial Intelligence · 2 worksComputer Science Applications · 2 worksInformation Systems · 2 worksLanguage and Linguistics · 2 works
🧭 Topics 2Research subjects and languages the work is about.Code & programming languages · 1 workLanguage models & pretraining · 1 work
Works by year
2020s
Papers
- GraphCodeBERT: Pre-training Code Representations with Data Flow (2021 · 332 citations)
Most pre-trained models for source code read a program as a plain token sequence. This ignores structural information that shows what the code actually does. GraphCodeBERT adds data flow to the input: a graph in which variables are nodes and directed edges show which variables each value is derived from. The authors… - Code Execution with Pre-trained Language Models (2023 · 38 citations)
Most pre-trained code models learn from source text and static structure such as ASTs or data flow. They do not see how a program actually behaves at runtime. This paper asks whether a Transformer can learn to emulate execution: given a Python program, it must generate the full execution trace, meaning the order in…
Co-authors here
- Alexey Svyatkovskiy ×2
- Nan Duan ×2
- Shuai Lu ×2
- Daxin Jiang
- Daya Guo
- Duyu Tang
- Long Zhou
- Michele Tufano
- Neel Sundaresan
- Shujie Liu
- Shuo Ren
- Weizhu Chen
Venues
- Findings of the Association for Computational Linguistics: Findings of the Association for Computational Linguistics 2023
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/shengyu-fu/