Papers of 2024 — page 3276 papers · all years1 2 3Out-of-Domain Dependency Parsing for Dialects of Arabic: A Case StudyNoor Abo Mokh, Daniel Dakota, Sandra KüblerSemitic languagesParameter-Efficient Fine-Tuning for Large Models: A Comprehensive SurveyZeyu Han, Chao Gao, Jinyang Liu, et al.arXiv:2403.14608Phi-3 Technical Report: A Highly Capable Language Model Locally on Your PhoneMarah Abdin, Jyoti Aneja, Hany Awadalla, et al.arXiv:2404.14219Phi-4 Technical ReportMarah Abdin, Jyoti Aneja, Harkirat Behl, et al.arXiv:2412.08905Picking Up Where the Linguist Left Off: Mapping Morphology to Phonology through Learning the ResidualsSalam Khalifa, Abdelrahim Qaddoumi, Ellen Broselow, et al.Semitic languagesPrayer and (Im)Politeness: Reading Psalm 7Ethan C. JonesAncient HebrewProducing a Parallel Universal Dependencies Treebank of Ancient Hebrew and Ancient Greek via Cross-Lingual ProjectionDaniel G. Swanson, Bryce D. Bussert, Francis TyersAncient HebrewPrometheus 2: An Open Source Language Model Specialized in Evaluating Other Language ModelsSeungone Kim, Juyoung Suk, Shayne Longpre, et al.arXiv:2405.01535PUB: A Pragmatics Understanding Benchmark for Assessing LLMs' Pragmatics CapabilitiesSettaluri Sravanthi, Meet Doshi, Pavan Tankala, et al.EnglishPyramidKV: Dynamic KV Cache Compression based on Pyramidal Information FunnelingZefan Cai, Yichi Zhang, Bofei Gao, et al.arXiv:2406.02069pyrealb at the GEM'24 Data-to-text Task: Symbolic English Text Generation from RDF TriplesGuy LapalmeEnglishQuaRot: Outlier-Free 4-Bit Inference in Rotated LLMsSaleh Ashkboos, Amirkeivan Mohtashami, Maximilian L. Croci, et al.arXiv:2404.00456Quest: Query-Aware Sparsity for Efficient Long-Context LLM InferenceJiaming Tang, Yilong Zhao, Kan Zhu, et al.arXiv:2406.10774Quiet-STaR: Language models can teach themselves to think before speakingResearch libraryQuIP#: Even Better LLM Quantization with Hadamard Incoherence and Lattice CodebooksAlbert Tseng, Jerry Chee, Qingyao Sun, et al.arXiv:2402.04396Qwen2-Audio Technical ReportYunfei Chu, Jin Xu, Qian Yang, et al.arXiv:2407.10759Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any ResolutionPeng Wang, Shuai Bai, Sinan Tan, et al.arXiv:2409.12191Qwen2.5-Coder Technical ReportBinyuan Hui, Jian Yang, Zeyu Cui, et al.arXiv:2409.12186Qwen2.5-Math Technical Report: Toward Mathematical Expert Model via Self-ImprovementAn Yang, Beichen Zhang, Binyuan Hui, et al.arXiv:2409.12122RAPTOR: Recursive Abstractive Processing for Tree-Organized RetrievalParth Sarthi, Salman Abdullah, Aditi Tuli, et al.arXiv:2401.18059RedPajama: an Open Dataset for Training Large Language ModelsMaurice Weber, Daniel Fu, Quentin Anthony, et al.arXiv:2411.12372ReFT: Reasoning with Reinforced Fine-TuningLuong Trung, Xinbo Zhang, Zhanming Jie, et al.Proceedings of the 62nd Annual Meeting of the…Refusal in Language Models Is Mediated by a Single DirectionAndy Arditi, Oscar Obeso, Aaquib Syed, et al.arXiv:2406.11717Replacing Judges with Juries: Evaluating LLM Generations with a Panel of Diverse ModelsPat Verga, Sebastian Hofstatter, Sophia Althammer, et al.arXiv:2404.18796ResearchAgent: Iterative Research Idea Generation over Scientific Literature with Large Language ModelsJinheon Baek, Sujay Kumar Jauhar, Silviu Cucerzan, et al.arXiv:2404.07738ReST-MCTS*: LLM Self-Training via Process Reward Guided Tree SearchDan Zhang, Sining Zhoubian, Ziniu Hu, et al.arXiv:2406.03816RSA-Control: A Pragmatics-Grounded Lightweight Controllable Text Generation FrameworkYifan Wang, Vera DembergEnglishRULER: What's the Real Context Size of Your Long-Context Language Models?Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.arXiv:2404.06654Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model ParametersCharlie Snell, Jaehoon Lee, Kelvin Xu, et al.arXiv:2408.03314Scaling Synthetic Data Creation with 1,000,000,000 PersonasTao Ge, Xin Chan, Xiaoyang Wang, et al.arXiv:2406.20094SeeClick: Harnessing GUI Grounding for Advanced Visual GUI AgentsKanzhi Cheng, Qiushi Sun, Yougang Chu, et al.arXiv:2401.10935ShortGPT: Layers in Large Language Models are More Redundant Than You ExpectXin Men, Mingyu Xu, Qingyu Zhang, et al.arXiv:2403.03853SIGA: A Naturalistic NLI Dataset of English Scalar Implicatures with Gradable AdjectivesRashid Nizamani, Sebastian Schuster, Vera DembergEnglishSkywork-Reward: Bag of Tricks for Reward Modeling in LLMsChris Yuhao Liu, Liang Zeng, Jiacai Liu, et al.arXiv:2410.18451SliceGPT: Compress Large Language Models by Deleting Rows and ColumnsSaleh Ashkboos, Maximilian L. Croci, Marcelo Gennari do Nascimento, et al.arXiv:2401.15024Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferenceBenjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.arXiv:2412.13663SnapKV: LLM Knows What You are Looking for Before GenerationYuhong Li, Yingbing Huang, Bowen Yang, et al.arXiv:2404.14469Solving olympiad geometry without human demonstrationsTrieu H. Trinh, Yuhuai Wu, Quoc V. Le, et al.Nature 625Some Notes on Lexicographic Criticism and Biblical Hebrew Studies. Revisiting David J. A. Clines's MethodClara Carbonell OrtizAncient HebrewStep-DPO: Step-wise Preference Optimization for Long-chain Reasoning of LLMsXin Lai, Zhuotao Tian, Yukang Chen, et al.arXiv:2406.18629StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style ElementsJillian Fisher, Skyler Hallinan, Ximing Lu, et al.Machine translationSurvey on Computational Approaches to ImplicatureKaveri Anuranjana, Srihitha Mallepally, Sriharshitha Mareddy, et al.EnglishSWE-agent: Agent-Computer Interfaces Enable Automated Software EngineeringJohn Yang, Carlos E. Jimenez, Alexander Wettig, et al.arXiv:2405.15793SWE-bench: Can Language Models Resolve Real-World GitHub Issues?Carlos E. Jimenez, John Yang, Alexander Wettig, et al.arXiv:2310.06770Syntactic Language Change in English and German: Metrics, Parsers, and ConvergencesYanran Chen, Wei Zhao, Anne Breitbarth, et al.EnglishThe AI Scientist: Towards Fully Automated Open-Ended Scientific DiscoveryChris Lu, Cong Lu, Robert Tjarko Lange, et al.arXiv:2408.06292The End of Desire: On the Meaning of תשוקה in the Hebrew Scriptures and the Dead Sea ScrollsJanson CondrenAncient HebrewThe Faiss libraryMatthijs Douze, Alexandr Guzhva, Chengqi Deng, et al.arXiv:2401.08281The FineWeb Datasets: Decanting the Web for the Finest Text Data at ScaleGuilherme Penedo, Hynek Kydlíček, Loubna Ben allal, et al.arXiv:2406.17557The Gricean Maxims in NLP — A SurveyLea Krause, Piek T.J.M. VossenEnglishThe Knesset Corpus: An Annotated Corpus of Hebrew Parliamentary ProceedingsGili Goldin, Nick Howell, Noam Ordan, et al.Modern HebrewThe Sale of Joseph in Genesis 37:18–26: Narrative Cohesion and CoherenceMatthew McAffeeAncient HebrewTinyLlama: An Open-Source Small Language ModelPeiyuan Zhang, Guangtao Zeng, Tianduo Wang, et al.arXiv:2401.02385To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoningZayne Sprague, Fangcong Yin, Juan Diego Rodriguez, et al.arXiv:2409.12183TOFU: A Task of Fictitious Unlearning for LLMsPratyush Maini, Zhili Feng, Avi Schwarzschild, et al.arXiv:2401.06121Token-Budget-Aware LLM ReasoningTingxu Han, Zhenting Wang, Chunrong Fang, et al.arXiv:2412.18547Towards Fine-Grained Pedagogical Control over English Grammar Complexity in Educational Text GenerationDominik Glandorf, Detmar MeurersEnglishTowards Named-Entity and Coreference Annotation of the Hebrew BibleDaniel G. Swanson, Bryce D. Bussert, Francis TyersAncient HebrewTower: An Open Multilingual Large Language Model for Translation-Related TasksDuarte M. Alves, Jose Pombal, Nuno M. Guerreiro, et al.arXiv:2402.17733Training Language Models to Self-Correct via Reinforcement LearningAviral Kumar, Vincent Zhuang, Rishabh Agarwal, et al.arXiv:2409.12917Training LLMs to Recognize Hedges in Dialogues about Roadrunner CartoonsAmie Paige, Adil Soubki, John Murzaku, et al.EnglishTrusting Your Evidence: Hallucinate Less with Context-aware DecodingWeijia Shi, Xiaochuang Han, Mike Lewis, et al.Proceedings of the 2024 Conference of the North…TrustLLM: Trustworthiness in Large Language ModelsYue Huang, Lichao Sun, Haoran Wang, et al.arXiv:2401.05561Tulu 3: Pushing Frontiers in Open Language Model Post-TrainingNathan Lambert, Jacob Morrison, Valentina Pyatkin, et al.arXiv:2411.15124Unifying the Scope of Bridging Anaphora Types in English: Bridging Annotations in ARRAU and GUMLauren Levine, Amir ZeldesEnglishV-STaR: Training Verifiers for Self-Taught ReasonersArian Hosseini, Xingdi Yuan, Nikolay Malkin, et al.arXiv:2402.06457Verbal strategies for expressing reciprocity – the case of HebrewBar-Asher Siegal, ElitzurModern HebrewVideo-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video AnalysisChaoyou Fu, Yuhan Dai, Yongdong Luo, et al.arXiv:2405.21075VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web TasksJing Yu Koh, Robert Lo, Lawrence Jang, et al.Proceedings of the 62nd Annual Meeting of the…WebVoyager: Building an End-to-End Web Agent with Large Multimodal ModelsHongliang He, Wenlin Yao, Kaixin Ma, et al.Proceedings of the 62nd Annual Meeting of the…What matters when building vision-language models?Hugo Lauren\ccon, Leo Tronchon, Matthieu Cord, et al.arXiv:2405.02246WildChat: 1M ChatGPT Interaction Logs in the WildWenting Zhao, Xiang Ren, Jack Hessel, et al.arXiv:2405.01470WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMsSeungju Han, Kavel Rao, Allyson Ettinger, et al.arXiv:2406.18495WordNet under Scrutiny: Dictionary Examples in the Era of Large Language ModelsFatemah Yousef Almeman, Steven Schockaert, Luis Espinosa AnkeEnglishxCOMET: Transparent Machine Translation Evaluation through Fine-grained Error DetectionNuno M. Guerreiro, Ricardo Rei, Daan van Stigt, et al.Transactions of the Association for…Yi: Open Foundation Models by 01.AIAlex Young, Bei Chen, Chao Li, et al.arXiv:2403.046521 2 3