Alexey Svyatkovskiy
Alexey Svyatkovskiy has 3 papers in our library, in 2020–2022, most of them on Code & programming languages, Language models & pretraining, Information retrieval & search; often with Daya Guo, Nan Duan, Shuai Lu.
OpenAlex · ORCID · Wikidata · h-index 117 · 642 works · 60,545 citations OpenAlex, 2026-10-14
📄 3 works in our library · 🔗 Cited 246 times in our library · ⭐ Paper Stars ranking: #3427
Affiliations
Fields, topics and concepts
📚 Shelves 6The field of science this work belongs to (OpenAlex fields).Arts and Humanities · 3 worksComputer Science · 3 worksArtificial Intelligence · 3 worksInformation Systems · 3 worksLanguage and Linguistics · 3 worksComputer Science Applications · 2 works
🧭 Topics 3Research subjects and languages the work is about.Code & programming languages · 2 worksLanguage models & pretraining · 1 workInformation retrieval & search · 1 work
Works by year
2020s
Papers
- GraphCodeBERT: Pre-training Code Representations with Data Flow (2021 · 332 citations)
Most pre-trained models for source code read a program as a plain token sequence. This ignores structural information that shows what the code actually does. GraphCodeBERT adds data flow to the input: a graph in which variables are nodes and directed edges show which variables each value is derived from. The authors… - PyMT5: multi-mode translation of natural language and Python code with transformers (2020 · 158 citations)
The paper tackles joint modeling of Python source code and its natural-language documentation. The authors propose a single sequence-to-sequence transformer, PyMT5, that converts in both directions: it writes method bodies from signatures or docstrings, and it summarizes code into docstrings. Code and text are… - ReACC: A Retrieval-Augmented Code Completion Framework (2022 · 125 citations)
Most code completion models only see the file or project being edited. Programmers, however, often reuse similar code from elsewhere. ReACC adds this external context by searching a large codebase for code that resembles the unfinished snippet and feeding the matches to the generator.
Co-authors here
- Daya Guo ×2
- Nan Duan ×2
- Shuai Lu ×2
- Dawn Drain
- Duyu Tang
- Long Zhou
- Seung-won Hwang
- Shujie Liu
- Shuo Ren
- Zhangyin Feng
Venues
- Annual Meeting of the Association for Computational Linguistics (ACL): ACL 2022
- Conference on Empirical Methods in Natural Language Processing (EMNLP): EMNLP 2020
Cited by
Updated
This page in Markdown → https://md.research.elamur.ai/free/en/authors/alexey-svyatkovskiy/