🧠 Language models & pretraining
Models that learn a language from raw text, and how they are pretrained, tuned and prompted.
- Contrastively Pre-trained Event Embeddings with Schema-free LLM AnnotationsFrank Mtumbuka, Steven Schockaert2026
- Controllable Sentence Simplification in Italian: Fine-Tuning Large Language Models on Automatically Generated ResourcesMichele Papucci, Giulia Venturi, Felice Dell'Orletta2026
- Crowdsourcing Piedmontese to Test LLMs on Non-Standard OrthographyGianluca Vico, Jindřich Libovický2026
- DAMETA: An LLM Benchmark for Danish Metaphor Interpretation with Systematically Varied DistractorsNina Skovgaard Schneidermann, Sanni Nimb, Nathalie Carmen Hau Norman, et al.2026
- Detecting Hallucinations in Authentic LLM–Human InteractionsYujie Ren, Niklas Gruhlke, Anne Lauscher2026
- Diff4TST: Masked Diffusion Language Model for Text Style TransferXinchen Ma, Gaole He, Yunshi Lan, et al.2026
- Discourse Structure Variation for Large Language Model Evaluation in Text Simplification (大模型文本简化的篇章结构变化分析与评测)Junhui Zhu (朱君辉), Erhong Yang (杨尔弘), Haonan Zhu (朱浩楠), et al.2026
- Do Factual Recall Mechanisms Carry over from Text to Speech in Multimodal Language Models?Luca Modica, Filip Landin, Mehrdad Farahani, et al.2026
- Do LLMs Use Relational Structure in KG-Grounded Dialogue? Evidence from Entity and Relation PerturbationDominic Okonkwo, Ismailcem Budak Arpinar2026
- Do Multimodal LLMs Understand Order? Measuring the Fragility of Multimodal Reasoning under Input Order PerturbationsSheng-Lun Wei, Yu-Ling Liao, Hen-Hsen Huang, et al.2026
- Dynamic Model Switching to Mitigate Outdated Knowledge in Large Language ModelsRamakrishna Pinninti, Sabyasachi Kamila, Ayan Mazumder, et al.2026
- EL-MIA: Quantifying Membership Inference Risks of Sensitive Entities in LLMsAli Satvaty, Suzan Verberne, Fatih Turkmen2026
- Enhancing the Role-playing Capabilities of Reasoning-optimized Large Language Models (推理型大语言模型角色扮演能力评估与优化)Xiachong Feng (冯夏冲), Yichong Huang (黄毅翀), Xiaocheng Feng (冯骁骋), et al.2026
- Entropy-aware Masking for Masked Language ModelingGokul Srinivasagan, Kai Hartung, Munir Georges2026
- Evaluating Discriminability of Vision-Language ModelsMasayasu Muraoka, Naoaki Okazaki2026
- Evaluating Humanities Theory Alignment in Large Language Models: Incremental Prompting and Statistical AssessmentAxel Pichler, Janis Pagel2026
- Evaluating LLM Style Transfer Through Readability-Based Age AssessmentsMaria Di Maro, Antonio Origlia, Leonilda Bilo, et al.2026
- Evaluating Multimodal Large Language Model Narrative Interpretation through the Lens of Appraisal TheoryJayant Teotia, Xiaowei Wang, Xulang Zhang, et al.2026
- Evaluating the Adaptability of Large Language Models to Linguistic VariationZiyan Xu, Marina Seghier, Alice Millour, et al.2026
- Evaluating the Effect of Question Wording Variations on Answer Consistency in Large Language ModelsJunya Takayama, Masaya Ohagi, Tomoya Mizumoto, et al.2026
- Evaluation Drift in LLM Personality Induction: Are We Moving the Goalpost?Prateek Kumar Rajput, Yewei Song, Iyiola Emmanuel Olatunji, et al.2026
- Evaluation of Multilingual Text Simplification for the Mental Health Domain: Exploring Small Language ModelsOlga Pelloni, Sandra Just, Lars Bongo2026
- Extending Czech Aspect-Based Sentiment Analysis with Opinion Terms: Dataset and LLM BenchmarksJakub Šmíd, Pavel Priban, Pavel Kral2026
- Facilitating Large Language Model-based Multiple-choice Reading Comprehension with Question-solving Thought (基于解题思维机制的大语言模型多项选择阅读理解增强框架)Yisong Su (苏艺淞), Yuanzhe Zhang (张元哲), Xiangwen Liao (廖祥文), et al.2026
- Few-shot Prompting or Supervised Tuning? A Comparative Study of LLMs for Linguistically Distant Language Pairs in BDIDeepen Naorem, Sanasam Ranbir Singh, Telem Joyson Singh, et al.2026
- Fill-in-the-Blanks: Automatic Generation and Evaluation of Language Models' Pseudonyms for English and Swedish TextsMaria Irena Szawerna, Jacob Lee Suchardt2026
- Finding Sense in Nonsense with Generated Contexts: Perspectives from Humans and Language ModelsKatrina Olsen, Sebastian Padó2026
- Focus particles and scalar inferences across humans and language modelsCatherine M. Brousse, Nelu D. Radpour2026
- From Perception to Reasoning: Deep Thinking Empowers Multimodal Large Language Models (从感知到推理:深度思考赋能多模态大语言模型)Wenxin Zhu (祝文鑫), Andong Chen (陈安东), Yuchen Song (宋宇宸), et al.2026
- From Rosetta to Match-Up: A Paired Corpus of Linguistic Puzzles with Human and LLM BenchmarksNeh Majmudar, Anne Huang, Jinfan Frank Hu, et al.2026
- Generation of Instruction and Preference Dataset for Improving Japanese Instruction Following in LLMsKei Moriyama, Takashi Kodama, Kouta Nakayama2026
- GPT-NL Public Corpus: A Permissively Licensed, Dutch-First Dataset for LLM Pre-trainingJesse J. Van Oort, Frank Brinkkemper, Erik de Graaf, et al.2026
- Grounding Arabic LLMs in the Doha Historical Dictionary: Retrieval-Augmented Understanding of Quran and HadithSomaya Eltanbouly, Samer Rashwani2026
- HEBATRON: A Hebrew-Specialized Open-Weight Mixture-of-Experts Language ModelNoam Kayzer, Dan Revital, Ori Bar Joseph, et al.2026
- HotelCheckSpan: A Benchmark Dataset for LLM FaithfulnessPatricia Schmidtova, Ondrej Dusek, Saad Mahamood2026
- How Far Can Bias Go? Tracing Bias from Pre-Training Data to AlignmentMarion Thaler, Abdullatif Köksal, Alina Leidinger, et al.2026
- Human vs LLM in Conversational Repair Annotation: A New Resource and Comparative StudyAnh Ngo, Nicolas Rollet, Catherine Pelachaud, et al.2026
- Human-AI Annotation Error Auditing for Hebrew Diacritization with Frontier LLMsHillel Gershuni, Avi Shmidman2026
- Identifying Imaging Follow-Up in Radiology Reports: A Comparative Analysis of Traditional ML and LLM ApproachesNamu Park, Giridhar Kaushik Ramachandran, Kevin Lybarger, et al.2026
- IndigiEval: Evaluating LLMs in North American Indigenous LanguagesJulia Mainzinger, Jacqueline Brixey2026
- InstructSum: A Benchmark to Evaluate Instruction-Following Capability of Large Language Models in SummarizationKosuke Nishida, Kyosuke Nishida, Itsumi Saito2026
- Investigating How LLMs Propagate Female Stereotypes: Comparing What Models Say via Prompts with What They Represent in Their EmbeddingsAndrea Valderrey Nuñez, Jelke Bloem2026
- Investigating Memorization in Language Models Trained via Knowledge DistillationMaarten Mäcking, Michaela Regneri2026
- Is AI Catching Up to Human Expression? Exploring Emotion, Personality, Authorship, and Linguistic Style in English and Arabic with Six Large Language ModelsNasser A Alsadhan2026
- Is Biomedical Specialization Still Worth It? Insights from Domain-Adaptive Language Modelling with a New French Health CorpusAidan Mannion, Cécile Macaire, Armand Violle, et al.2026
- JudgeMeNot: Personalizing Large Language Models to Emulate Judicial Reasoning in HebrewItay Razumenko, Arnon Sturm, Nir Grinberg2026
- K-CoT: Chinese Parallelism Generation Based on Keywords Chain-of-Thought Prompting (K-CoT:基于关键词思维链提示的中文排比句生成研究)Maosheng Zhong (钟茂生), Jiaqi Gan (甘家其), Hejun Zhang (张鹤君), et al.2026
- Large Language Models Put to the Test on Chinese Noun Compounds: Experiments on Natural Language Inference and Compound SemanticsLe Qiu, Emmanuele Chersoni, He Zhou, et al.2026
- Leveraging Decoupled Composition in Large Language Models for Knowledge Base Question Answering (基于解耦与组合的大模型知识问答方法)Shengze Shi (施圣泽), Li Qin (秦利), Jun Hu (胡军), et al.2026
- LLM as a Morphological Disambiguator for Belarusian: A Preliminary StudyVladislav Poritski, Oksana Volchek, Ilia Afanasev2026
- LLM-Assisted Spanish Dialect Corpus ConstructionJessica Claribel RAMIREZ VIDAL, Hiroki Ouchi, Sakriani Sakti2026
- LLMs as Annotators: Evaluating Model–Human Alignment in Detecting Contentious Language in Historical CorporaYahui Zhao, Clemencia Siro, Laura Hollink2026
- LLMs Out-of-the-Box Do Not Generate Context-Appropriate Word Order in RussianAlina Shabaeva, John Frederick Bailyn, Owen Rambow2026
- LocRegen: Cost-Efficient Redundancy Removal in Multilingual E-commerce Titles with Small Language ModelsBryan Zhang, Stephan Walter, Luca Lomanto, et al.2026
- Low-Rank Compression of Language Models via Differentiable Rank SelectionSidhant Sundrani, Francesco Tudisco, Pasquale Minervini2026
- MASA: A Novel Multimodal Foundation Model for L2 Speaking Assessment in Picture-description ScenariosBi-Cheng Yan, Fu-An Chao, Hong-Yun H.Y. Lin, et al.2026
- Memorization or Lucky Guesses: Detecting Short Sequences from Copyrighted Dutch News in LLM OutputJoris Veerbeek, Kas Berendsen, Alessandra Polimeno, et al.2026
- Merging Continual Pretraining Models for Domain-Specialized LLMs: A Case Study in FinanceKentaro Ueda, François Portet, Hirohiko Suwa, et al.2026
- MEUR: A Benchmark for Evaluating Vision-Language Models on Multimodal Event Understanding and ReasoningZimu Wang, Yuqi Wang, Tong Chen, et al.2026
- Mind the Language Gap: Assessing LLM Safety in ItalianElena Marafatto, Roberto Navigli2026
- Modeling semantic association in self-paced reading with language model embeddingsSara Møller Østergaard, Kenneth Enevoldsen, Afra Alishahi, et al.2026
- MT-Video-Bench: A Holistic Video Understanding Benchmark for Evaluating Multimodal LLMs in Multi-Turn DialoguesYaning Pan, Qianqian Xie, Guohui Zhang, et al.2026
- Multi-Task Instruction Tuning via Data Scheduling for Low-Resource Arabic SpeechLLMsHunzalah Hassan Bhatti, Firoj Alam, Shammur Absar Chowdhury2026
- Multimodal LLMs Do Not Compose Skills Optimally across ModalitiesPaula Ontalvilla, Aitor Ormazabal, Gorka Azkune2026
- MzansiText and MzansiLM: An Open Corpus and Decoder-Only Language Model for South African LanguagesAnri M. Lombard, Simbarashe Mawere, Temi Aina, et al.2026
- Nuha-Speech: Building General-Purpose Arabic Speech-LLMsYingzhi Wang, Reem Alhazzani, Muhammad Alqurishi2026
- On the Use of LLMs for Specialised Terminology: A Good Alternative to Corpora?Joachim Minder, Guillaume Wisniewski, Natalie Kübler2026
- Onomasiological Sense Alignment Across Dialect Dictionaries. A Taxonomy-Constrained LLM ClassificationNathalie Mederake, Nico Urbach, Hanna Fischer, et al.2026
- Open-access Dataset on Acceptability Ratings of Korean Clausal Constructions by Humans and GPT ModelsGyu-Ho Shin, Soo-Hwan Lee, Chanyoung Lee2026
- Orthographic Constraint Satisfaction and Human Difficulty Alignment in Large Language ModelsBryan E. Tuck, Rakesh Verma2026
- Persona-Aware Evaluation of Cognitive Bias in LLMs: From Benchmark to Applied Decision-MakingKatsumasa Yoshikawa, Junya Takayama, Takato Yamazaki2026
- Probing Discrete Speech Tokens of Spoken Language ModelsSven Naber, Julia Koch, Pranav Singh, et al.2026
- Probing the Dynamics of Syntactic Ability Acquisition Throughout LLM PretrainingHiroshi Matsuda, Masayuki Asahara2026
- Proficiency-Controlled Text Simplification in European Portuguese: A Preliminary Study using Prompting ApproachesEugénio Ribeiro, David Antunes, Nuno Mamede, et al.2026
- Quantifying Metric and Model Agreement in Bias Evaluation of Large Language ModelsArash Asgari, Huan Wu, Amirreza Naziri, et al.2026
- Quantifying the Accuracy and Cost Impact of Design Decisions in Budget-Constrained Agentic LLM SearchKyle A. McCleary, James M. Ghawaly2026
- Questionnaire Meets LLM: A Benchmark and Empirical Study of Structural Skills for Understanding Questions and ResponsesDuc-Hai Nguyen, Vijayakumar Nanjappan, Barry O'Sullivan, et al.2026
- R.U.Psycho? A Framework for Robust Unified Psychometric Testing of Language ModelsJulian Schelb, Orr Borin, David Garcia, et al.2026
- Rethinking the Idiomaticity Decomposability Hypothesis: Evidence from Distributional LearningMaggie Mi, Golzar Atefi, Atsuki Yamaguchi, et al.2026
- Retrieval-augmented Chain-of-thought Prompting Method for Chinese Frame Semantic Parsing (基于检索增强思维提示的汉语框架语义解析方法)Yingxu Li (李迎旭), Tao Chen (陈涛), Binyang Li (李斌阳), et al.2026
- Retrieving Responses Useful as References in Counseling via LLM-Generated Structurally Analogous DialoguesYu Nakagawa, Nozomu Ikeda, Kotaro Funakoshi, et al.2026
- SalamahBench: Dialect and Category Level Safety Evaluation of Arabic Language ModelsOmar Abdelnasser, Fatemah Alharbi, Khaled Khasawneh, et al.2026
- SearchLLM: Detecting LLM Paraphrased Text by Measuring the Similarity with Regeneration of the Candidate Source via Search EngineHoang-Quoc Nguyen-Son, Minh-Son Dao, Koji Zettsu2026
- Seeing the Other Side: Diagnostic Tasks for Viewpoint Reasoning in Vision–Language ModelsMakoto Takenaka, Hitomi Yanaka2026
- Semantic Parsing for Evaluating Large Language Models: Separating Linguistic Abilities with YARNRémi DE VERGNETTE, Maxime Amblard2026
- SemBench: A Universal Semantic Framework for LLM EvaluationMikel Zubillaga, Naiara Perez, Oscar Sainz, et al.2026
- SemToken: Semantic-Aware Tokenization for Efficient Long-Context Language ModelsDong Liu, Yanxuan Yu2026
- Sentiment Analysis and Language Models for KwanyamaNdapa Nakashole2026
- Sentiment Classification of Gaza War Headlines: A Comparative Analysis of Large Language Models and Arabic Fine-Tuned BERT ModelsAmr Eleraqi; Hager H. Mustafa;, Abdul Hadi N. Ahmed2026
- Similar Predictions, Different Processes: A Multi-Level Comparison of Human and Multimodal LLM Language PredictionShuqi Wang, Zhenguang Cai2026
- Simulating Student Interactions for Virtual Pretesting with In-Context LearningArthur Thuy, Luca Benedetto, Ekaterina Loginova, et al.2026
- SlovKE: A Large-Scale Dataset and LLM Evaluation for Slovak Keyphrase ExtractionDávid Števaňák, Marek Suppa2026
- Small Language Models for Less-Resourced Languages in a Real-World Scenario: The Case for CatalanRoser Saurí, Josep Sànchez-Ferreres, Lluis Padro, et al.2026
- Some Dialects Are More Equal Than Others: Non-Prestigious Arabic Dialectal Bias in LLMsMai Mohamed Eida, Ryan Dolan, Paul de Nijs, et al.2026
- SPQ: An Ensemble Technique for Large Language Model CompressionJiamin Yao, Eren Gultepe2026
- Structured Prompting for Arabic Essay Proficiency: A Trait-Centric Evaluation ApproachSalim Al Mandhari, Hieu Pham Dinh, Mo El-Haj, et al.2026
- STRUDEL: Unrolling a Benchmark for Evaluating Vision-Language Models on Structured Diagram Understanding across DomainsDaniel Steinigen, Lucie Flek, Sebastian Houben2026
- Studying Expert-ese: Profiling and Classification of Domain-Specific Language Variation in Architecture with Traditional Machine Learning and LLMsCarmen Schacht, Renate Delucchi Danhier2026
- Survey on KV Cache Compression Methods for Large Language Model Inference (大语言模型推理中的键值缓存压缩方法综述)Shipeng Hu (胡世鹏), Guangyan Zhang (张广艳), Weimin Zheng (郑纬民)2026
- Syntactic Priming in Few-Shot Learning: How Demonstration Structure Shapes LLM PerformancePrasanth Yadla2026
This page in Markdown → https://md.research.elamur.ai/free/en/topics/language-models/page/11/