🧠 Language models & pretraining
Models that learn a language from raw text, and how they are pretrained, tuned and prompted.
- Let's Simplify Step by Step: Guiding LLM Towards Multilingual Unsupervised Proficiency-Controlled Sentence SimplificationJingshen Zhang, Xin Ying Qiu, Lifang Lu, et al.2026 · 3 citations
- Baseer: A Vision-Language Model for Arabic Document-to-Markdown OCRKhalil Hennara, Muhammad Hreden, Mohamed Motasim Hamed, et al.2025 · 3 citations
- BLiMP-IT: Harnessing Automatic Minimal Pair Generation for Italian Language Model EvaluationMatilde Barbini, Maria Letizia Piccini Bianchessi, Veronica Bressan, et al.2025 · 3 citations
- Few-Shot Prompting for Extractive Quranic QA with Instruction-Tuned LLMsMohamed Basem, Islam Oshallah, Ali Hamdi, et al.2025 · 3 citations
- Sadeed: Advancing Arabic Diacritization Through Small Language ModelZeina Aldallal, Sara Chrouf, Khalil Hennara, et al.2025 · 3 citations
- What did you say? Generating Child-Directed Speech Questions to Train LLMsWhitney Poh, Michael Tombolini, Libby Barak2025 · 3 citations
- A Language Modeling Approach to Diacritic-Free Hebrew TTSAmit Roth, Arnon Turetzky, Yossi Adi2024 · 3 citations
- ASOS at Arabic LLMs Hallucinations 2024: Can LLMs detect their Hallucinations :)Serry Taiseer Sibaee, Abdullah I. Alharbi, Samar Ahmed, et al.2024 · 3 citations
- Evaluating large language models for the tasks of PoS tagging within the Universal Dependency frameworkMateus Machado, Evandro Ruiz2024 · 3 citations
- Token-level Identification of Multiword Expressions using Pre-trained Multilingual Language ModelsRaghuraman Swaminathan, Paul Cook2023 · 3 citations
- Bridging Scientific Heritage: An Arabic — Russian Parallel Corpus and LLM Benchmark for Sustainable Knowledge TransferMullosharaf K. Arabov2026 · 2 citations
- Can LLMs Simulate Human Behavioral Variability? A Case Study in the Phonemic Fluency TaskMengyang Qiu, Zoe Brisebois, Siena Sun2026 · 2 citations
- Dicta-LM 3.0: Advancing The Frontier of Hebrew Sovereign LLMsShaltiel Shmidman, Avi Shmidman, Amir DN Cohen, et al.2026 · 2 citations
- J-CHAT: Japanese Large-scale Spoken Dialogue Corpus for Spoken Dialogue Language ModelingWataru Nakata, Kentaro Seki, Hitomi Yanaka, et al.2026 · 2 citations
- KZ-SafetyPrompts: A Kazakh Safety Evaluation Prompt Dataset for Large Language ModelsWajdi Zaghouani, Shimaa Amer Ibrahim, Aruzhan Muratbek, et al.2026 · 2 citations
- PHEB: An European Portuguese High School-Level LLM BenchmarkDiogo C. Tavares, Rafael Ferreira, Afonso Simplício, et al.2026 · 2 citations
- Prompting Instruction-tuned LLMs for Semantic Similarity ValuesXander Akiko Snelder, Yunchong Huang, Jelke Bloem2026 · 2 citations
- The Riddle of Reflection: Evaluating Reasoning and Self-Awareness in Multilingual LLMs Using Indian RiddlesAbhinav P M, Ojasva Saxena, Oswald C, et al.2026 · 2 citations
- UrBLiMP: A Benchmark for Evaluating the Linguistic Competence of Large Language Models in UrduFarah Adeeba, Brian Dillon, Hassan Sajjad, et al.2026 · 2 citations
- Arabizi vs LLMs: Can the Genie Understand the Language of Aladdin?Perla Al Almaoui, Pierrette Bouillon, Simon Hengchen2025 · 2 citations
- Can Large Language Models Predict the Outcome of Judicial Decisions?Mohamed Bayan Kmainasi, Ali Ezzat Shahroor, Amani Al-Ghraibah2025 · 2 citations
- How Well Do LLMs Understand Tunisian Arabic?Mohamed Mahdi2025 · 2 citations
- Step-by-step Instructions and a Simple Tabular Output Format Improve the Dependency Parsing Accuracy of LLMsHiroshi Matsuda, Chunpeng Ma, Masayuki Asahara2025 · 2 citations
- Transforming Causal LLM into MLM Encoder for Detecting Social Media Manipulation in TelegramAnton Bazdyrev, Ivan Bashtovyi, Ivan Havlytskyi, et al.2025 · 2 citations
- UI-Level Evaluation of ALLaM 34B: Measuring an Arabic-Centric LLM via HUMAIN ChatOmer Nacar2025 · 2 citations
- Evaluating the Quality of a Corpus Annotation Scheme Using Pretrained Language ModelsFurkan Akkurt, Onur Gungor, Büşra Marşan, et al.2024 · 2 citations
- Using Curriculum Masking Based on Child Language Development to Train a Large Language Model with Limited Training DataEvan Lucas, Dylan Gaines, Tagore Rao Kosireddy, et al.2024 · 2 citations
- WordNet under Scrutiny: Dictionary Examples in the Era of Large Language ModelsFatemah Yousef Almeman, Steven Schockaert, Luis Espinosa Anke2024 · 2 citations
- Improving Natural Language Inference in Arabic using Transformer Models and Linguistically Informed Pre-TrainingMohammad Majd Saad Al Deen, Maren Pielka, Jorn Hees, et al.2023 · 2 citations
- Comparing Native and Learner Englishes Using a Large Pre-trained Language ModelTatsuya Aoyama2022 · 2 citations
- Addressing the Ecological Fallacy in Larger LMs with Human ContextNikita Soni, Dhruv Vijay Kunjadiya, Pratham Piyush Shah, et al.2026 · 1 citation
- AlbanianLLMSafety: A Safety Evaluation Dataset for Large Language Models in AlbanianWajdi Zaghouani, Kholoud Khalil Aldous, Isra Fejzullaj2026 · 1 citation
- An Existence Proof for Neural Language Models That Can Explain Garden-Path Effects via SurprisalRyo Yoshida, Shinnosuke Isono, Taiga Someya, et al.2026 · 1 citation
- Are LLMs Good Text Diacritizers? An Arabic and Yoruba Case StudyHawau Olamide Toyin, Samar Mohamed Magdy, Hanan Aldarmaki2026 · 1 citation
- Bridging the Culture Gap: A Framework for LLM-Driven Socio-Cultural Localization of Math Word Problems in Low-Resource LanguagesIsrael Abebe Azime, Tadesse Destaw Belay, Dietrich Klakow, et al.2026 · 1 citation
- Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMsKareem Elozeiri, Mervat Abassy, Omar Kallas, et al.2026 · 1 citation
- Can LLMs Translate Italy's Language Varieties?Edoardo Signoroni, Pavel Rychlý2026 · 1 citation
- Children's English Reading Story Generation via Supervised Fine-Tuning of Compact LLMs with Controllable Difficulty and SafetyQian Shen, Fanghua Cao, Min Yao, et al.2026 · 1 citation
- Clozing the Gap: Exploring Why Language Model Surprisal Outperforms Cloze SurprisalSathvik Nair, Byung-Doh Oh2026 · 1 citation
- Culturally-Aware Image Captioning for Guaraní with Multimodal Prompting: IUHoosiers at AmericasNLP 2026Wenchen Shi, Phakphum Artkaew, Luke Gessler2026 · 1 citation
- Do LLMs Judge Distantly Supervised Named Entity Labels Well? Constructing the JudgeWEL DatasetAlistair Plum, Laura Maria Bernardy, Tharindu Ranasinghe2026 · 1 citation
- Evaluation of Adversarial Robustness in Arabic Language ModelsAnwar Alajmi, Ayed Salman, Imtiaz Ahmad2026 · 1 citation
- German General Social Survey Personas: A Survey-Derived Persona Prompt Collection for Population-Aligned LLM StudiesJens Rupprecht, Leon Froehling, Claudia Wagner, et al.2026 · 1 citation
- HPLT 3.0: Very Large-Scale Multilingual Resources for LLMs and MT. Mono- and Bi-lingual Data, Multilingual Evaluation, and Pre-Trained ModelsStephan Oepen, Nikolay Arefyev, Mikko Aulamo, et al.2026 · 1 citation
- Human-like Fleeting Memory Improves Language Learning but Impairs Reading Time Prediction in Transformer Language ModelsAbishek Thamma, Micha Heilbron2026 · 1 citation
- Improving Dialect Robustness in Large Language Models via LoRA and Mixture-of-ExpertsSanjh Maheshwari, Aniket Singh Rajpoot, Oana Cocarascu, et al.2026 · 1 citation
- In-Distribution Steering: Balancing Control and Coherence in Language Model GenerationArthur Vogels, Benjamin Wong, Yann Choho, et al.2026 · 1 citation
- ITUNLP at MWE-2026 AdMIRe 2: A Zero-Shot LLM Pipeline for Multimodal Idiom Understanding and RankingAtakan Site, Oğuz Ali Arslan, Gülşen Eryiğit2026 · 1 citation
- Language Models Learn Constructional Semantics, Not To Mention Syntax: Investigating LM Understanding of Paired-Focus ConstructionsWesley Scivetti, Ethan Gotlieb Wilcox, Nathan Schneider, et al.2026 · 1 citation
- Large Language Models Are Good Term Extractors: A Systematic EvaluationRigouts Terryn, Ayla2026 · 1 citation
- Large Language Models for Citation Function ClassificationDaniel Vodička, Pavel Kral, Christophe Cerisara, et al.2026 · 1 citation
- Missing Links: LLM-Augmentation of Event Triggers of State Changes in the OpenPI DatasetKyeongmin Rim, James Pustejovsky2026 · 1 citation
- Modeling the Human Lexicon under Temperature Variations: Linguistic Factors, Diversity and Typicality in LLM Word AssociationsMaria A. Rodriguez, Marie Candito, Richard Huyghe2026 · 1 citation
- Morphemes Without Borders: Evaluating Root-Pattern Morphology in Arabic Tokenizers and LLMsYara Alakeel, Chatrine Qwaider, Hanan Aldarmaki, et al.2026 · 1 citation
- Morphemes without Borders: Evaluating Root–Pattern Morphology in Arabic Tokenizers and LLMsYara Yousif Alakeel, Chatrine Qwaider, Hanan Aldarmaki, et al.2026 · 1 citation
- Multi-modal, Multi-task, Multi-criteria Automatic Evaluation with Vision Language ModelsMasanari Oi, Masahiro Kaneko, Naoaki Okazaki, et al.2026 · 1 citation
- NUS-IDS at AMIYA/VarDial 2026: Improving Arabic Dialectness in LLMs with Reinforcement LearningSujatha Das Gollapalli, Mouad Hakam, Mingzhe Du, et al.2026 · 1 citation
- Optimizing Multilingual LLMs via Federated Learning: A Study of Client Language CompositionAleix Sant, Jordi Luque, Carlos Escolano2026 · 1 citation
- Rhetorical Questions in LLM Representations: A Linear Probing StudyLouie Hong Yao, Vishesh Anand, Yuan Zhuang, et al.2026 · 1 citation
- Structured Entity Extraction from Hawaiian Television Chyrons Using Vision-Language ModelsKelley Lynch, Owen King, Kyeongmin Rim, et al.2026 · 1 citation
- Tug-of-war between idioms' figurative and literal interpretations in LLMsSoyoung Oh, Xinting Huang, Mathis Pink, et al.2026 · 1 citation
- Adaptive Originality Filtering: Rejection Based Prompting and RiddleScore for Culturally Grounded Multilingual Riddle GenerationDuy Le, Kent Ziti, Evan Girard-Sun, et al.2025 · 1 citation
- Arabic Dialect Classification using RNNs, Transformers, and Large Language Models: A Comparative AnalysisOmar A.Essameldin, Ali O.Elbeih, Wael H.Gomaa, et al.2025 · 1 citation
- Batch-wise Convergent Pre-training: Step-by-Step Learning Inspired by Child Language DevelopmentKo Yoshida, Daiki Shiono, Kai Sato, et al.2025 · 1 citation
- Construction Grammar Evidence for How LLMs Use Context-Directed Extrapolation to Solve TasksHarish Tayyar Madabushi, Claire Bonial2025 · 1 citation
- Rationale-Guided Distillation for E-Commerce Relevance Classification: Bridging Large Language Models and Lightweight Cross-EncodersSanjay Agrawal, Faizan Ahemad, Vivek Varadarajan Sembium2025 · 1 citation
- System Report for CCL25-Eval Task 4: Prompting, Scheduling, and Arbitration Strategies for Chinese Factivity InferenceDaohuan Liu, Lun Xia, Yuxuan Zhang, et al.2025 · 1 citation
- AlcLaM: Arabic Dialectal Language ModelMurtadha Ahmed, Saghir Alfasly, Bo Wen, et al.2024 · 1 citation
- Creating Arabic LLM Prompts at ScaleAbdelrahman El-Sheikh, Ahmed Elmogtaba, Kareem Darwish, et al.2024 · 1 citation
- Dreaming Out Loud: A Self-Synthesis Approach For Training Vision-Language Models With Developmentally Plausible DataBadr AlKhamissi, Yingtian Tang, Abdülkadir Gökce, et al.2024 · 1 citation
- Investigating Persuasion Techniques in Arabic: An Empirical Study Leveraging Large Language ModelsAbdurahmman Alzahrani, Eyad Babkier, Faisal Yanbaawi, et al.2024 · 1 citation
- Knesset-DictaBERT: A Hebrew Language Model for Parliamentary ProceedingsGili Goldin, Shuly Wintner Department of Computer Science, University of Haifa, et al.2024 · 1 citation
- Assessing the influence of attractor-verb distance on grammatical agreement in humans and language modelsChristos Zacharopoulos, Théo Desbordes, Mathias Sablé-Meyer2023 · 1 citation
- Introducing DictaLM — A Large Generative Language Model for Modern HebrewShaltiel Shmidman, Avi Shmidman, Amir David Nissan Cohen, et al.2023 · 1 citation
- QA-KGNet: Language Model-driven Knowledge Graph Question-answering Model (QA-KGNet: 一种语言模型驱动的知识图谱问答模型)Shaojie Qiao (乔少杰), Guoping Yang (杨国平), Yong Yu (于泳), et al.2023 · 1 citation
- A Binary Problem in Binary QA: Diverse LLMs or Diverse Question Interpretations? That Is the Ensembling QuestionRafael Rosales, Santiago Miret2026
- A Cascade Reinforcement Learning Strategy for Efficiently Enhancing the Reasoning Ability of Multimodal Large Language Models (高效提升多模态大语言模型推理能力的级联强化学习策略)Weiyun Wang (王玮赟), Hengjun Pu (蒲恒骏), Linglin Jing (景凌林), et al.2026
- A Chinese Character Riddle Solving Model Based on Pre-trained Language Models (基于预训练语言模型的汉语字形谜解谜模型)Hanyu Wang (王涵玉), Xun Liang (梁循), Zhenyu Guan (关真宇), et al.2026
- A Large-Scale Instruction-Tuning Dataset and Models for Slovenian Vision-Language TasksMatej Martinc, Domen Vreš2026
- A Multilingual Red Teaming–Driven Safety Analysis of LLMsPatrícia Pandeiro, Vera Cabarrão, Helena Moniz2026
- A Reasoning Path Ranking Method for Reasoning Optimization of Small-scale Large Language Models (面向小规模大语言模型推理优化的推理路径排序方法)Jun Li (李俊), Yu Bai (白宇), Yuting Liu (刘雨婷)2026
- AgriChain: Visually-Grounded Expert-Verified Reasoning for Interpretable Agricultural Vision–Language ModelsHazza Mahmood, Yongqiang Yu, Rao Anwer2026
- AnswerCarefully: Creating a Dataset for LLM Safety in JapaneseHisami Suzuki, Satoru Katsumata, Takashi Kodama, et al.2026
- ArabicNumBench: Evaluating Arabic Number Reading in Large Language ModelsAnas Alhumud, Abdulaziz Alhammadi, Muhammad Badruddin Khan2026
- Are Arabic Benchmarks Reliable? QIMMA's Quality-First Approach to LLM EvaluationLeen AlQadi, Ahmed Alzubaidi, Mohammed Alyafeai, et al.2026
- Are Language Models Borrowing-Blind? A Multilingual Evaluation of Loanword Identification across 10 LanguagesMerilin Sousa Silva, Sina Ahmadi2026
- Are Social Biases in LLMs Consistent across Generative Tasks? A Case Study for BasqueMuitze Zulaika, Xabier Saralegi, Julia Shershneva, et al.2026
- Are the LLMs Capable of Maintaining at Least the Language Genus?Sandra Mitrović, David Kletz, Ljiljana Dolamic, et al.2026
- Artful Writing, Authentic Emotions: Distinguishing Human-Written from LLM-Generated Metaphors by Annotation and ClassificationMichaela Regneri, Nooshin Aghajari, Thomas Kroedel2026
- Assessing Small Language Models as Text Simplification EvaluatorsDavid Carranza Navarrete, Jan Bakker, Jaap Kamps2026
- Assessing Suicide Risk in Arabic Crisis Helpline Calls: A Comparison of Arabic and English Large Language ModelsLinhai Ma, Rita El Hachem, Mahatab El Hajj, et al.2026
- Augmenting LLM Reasoning with Dynamic Notes Writing for Complex MultiHop QARishabh Maheshwary, Masoud Hashemi, Khyati Mahajan, et al.2026
- Beyond Cultural Knowledge: Evaluating Arabic Cultural Appropriateness of Large Language ModelsEnes Altinisik, Hamdy Mubarak, Masoomali Fatehkia, et al.2026
- Breaking the Benchmark: Revealing LLM Bias via Minimal Contextual AugmentationKaveh Eskandari Miandoab, Mahammed Kamruzzaman, Arshia Gharooni, et al.2026
- Bridging Linguistic Structure and Mechanistic Interpretability for Conceptual Interpretation in Language ModelsNura Aljaafari, Danilo Carvalho, Andre Freitas2026
- Can Video LLMs See Through Illusions? Video-Illusion QA Benchmark DatasetSouto Ohira, Tosho Hirasawa, Mamoru Komachi2026
- Causal Inferences Are Driven by Noun Concept Specificity Evidence from Self-Paced Reading and Large Language Model SurprisalFabian Schlotterbeck, Raphael Barth2026
- Common Sense vs. Morality: The Curious Case of Narrative Focus Bias in LLMsSaugata Purkayastha, Pranav Kushare, Pragya Paramita Pal, et al.2026
- Compositional Meaning Representations in LLMs: a Critical Review of Probing StudiesRémy Marro2026
- Consistency of LLMs to Comparative Statements in Mathematical Reasoning TasksAidan W. San, Daniel Juyoung Son, Xiaodong Liu, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/topics/language-models/page/10/