Who cites Rameswar Panda
- A Survey of Large Language ModelsFrontiers of Computer ScienceWayne Xin Zhao, Kun Zhou, Junyi Li, et al.2023 · 2,875 citations
- Yi: Open Foundation Models by 01.AIarXiv:2403.04652Alex Young, Bei Chen, Chao Li, et al.2024 · 408 citations
- RULER: What's the Real Context Size of Your Long-Context Language Models?arXiv:2404.06654Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman, et al.2024 · 400 citations
- Smarter, Better, Faster, Longer: A Modern Bidirectional Encoder for Fast, Memory Efficient, and Long Context Finetuning and InferencearXiv:2412.13663Benjamin Warner, Antoine Chaffin, Benjamin Clavié, et al.2024 · 358 citations
- xLSTM: Extended Long Short-Term MemoryConference on Neural Information Processing Systems (NeurIPS)Maximilian Beck, Korbinian Pöppel, Markus Spanring, et al.2024 · 296 citations
- HippoRAG: Neurobiologically Inspired Long-Term Memory for Large Language ModelsConference on Neural Information Processing Systems (NeurIPS)Bernal Jimenez Gutierrez, Yiheng Shu, Yu Gu, et al.2024 · 268 citations
- MInference 1.0: Accelerating Pre-filling for Long-Context LLMs via Dynamic Sparse AttentionConference on Neural Information Processing Systems (NeurIPS)Huiqiang Jiang, Yucheng Li, Chengruidong Zhang, et al.2024 · 202 citations
- FlashInfer: Efficient and Customizable Attention Engine for LLM Inference ServingMLSys 2025Zihao Ye, Lequn Chen, Ruihang Lai, et al.2025 · 177 citations
- BigCodeBench: Benchmarking Code Generation with Diverse Function Calls and Complex InstructionsarXiv:2406.15877Terry Yue Zhuo, Minh Chien Vu, Jenny Chim, et al.2024 · 176 citations
- The Troubling Emergence of Hallucination in Large Language Models - An Extensive Definition, Quantification, and Prescriptive RemediationsConference on Empirical Methods in Natural Language Processing (EMNLP)Vipula Rawte, Swagata Chakraborty, Agnibh Pathak, et al.2023 · 171 citations
- PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information FunnelingarXiv:2406.02069Zefan Cai, Yichi Zhang, Bofei Gao, et al.2024 · 155 citations
- ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool EmbeddingsConference on Neural Information Processing Systems (NeurIPS)Shibo Hao, Tianyang Liu, Zhen Wang, et al.2023 · 147 citations
- Many-Shot In-Context LearningConference on Neural Information Processing Systems (NeurIPS)Rishabh Agarwal, Avi Singh, Lei M. Zhang, et al.2024 · 142 citations
- MLVU: Benchmarking Multi-task Long Video UnderstandingIEEE Computer Society Conference on Computer Vision and Pattern RecognitionJunjie Zhou, Yan Shu, Bo Zhao, et al.2024 · 140 citations
- Long-context LLMs Struggle with Long In-context LearningarXiv:2404.02060Tianle Li, Ge Zhang, Quy Duc Do, et al.2024 · 138 citations
- LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context MultitasksarXiv:2412.15204Yushi Bai, Shangqing Tu, Jiajie Zhang, et al.2024 · 135 citations
- Efficient Large Language Models: A SurveyarXiv:2312.03863Zhongwei Wan, Xin Wang, Che Liu, et al.2023 · 110 citations
- Data Engineering for Scaling Language Models to 128K ContextarXiv:2402.10171Yao Fu, Rameswar Panda, Xinyao Niu, et al.2024 · 109 citations
- PromptAgent: Strategic Planning with Language Models Enables Expert-level Prompt OptimizationarXiv:2310.16427Xinyuan Wang, Chenxi Li, Zhen Wang, et al.2023 · 102 citations
- Make Your LLM Fully Utilize the ContextConference on Neural Information Processing Systems (NeurIPS)Shengnan An, Zexiong Ma, Zeqi Lin, et al.2024 · 97 citations
- LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive MemoryarXiv:2410.10813Di Wu, Hongwei Wang, Wenhao Yu, et al.2024 · 95 citations
- Retrieval Head Mechanistically Explains Long-Context FactualityarXiv:2404.15574Wenhao Wu, Yizhong Wang, Guangxuan Xiao, et al.2024 · 94 citations
- How to Train Long-Context Language Models (Effectively)Annual Meeting of the Association for Computational Linguistics (ACL)Tianyu Gao, Alexander Wettig, Howard Yen, et al.2025 · 89 citations
- PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language ModelsarXiv:2404.02948Fanxu Meng, Zhaohui Wang, Muhan Zhang2024 · 86 citations
- In-Context Learning with Long-Context Models: An In-Depth ExplorationConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Amanda Bertsch, Maor Ivgi, Emily Xiao, et al.2025 · 81 citations
- Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attentionarXiv:2404.07143Tsendsuren Munkhdalai, Manaal Faruqui, Siddharth Gopal2024 · 80 citations
- SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-ScalingarXiv:2312.15166Dahyun Kim, Chanjun Park, Sanghoon Kim, et al.2023 · 77 citations
- Long Context Transfer from Language to VisionarXiv:2406.16852Peiyuan Zhang, Kaichen Zhang, Bo Li, et al.2024 · 73 citations
- MiniMax-M1: Scaling Test-Time Compute Efficiently with Lightning AttentionarXiv:2506.13585MiniMax, Aili Chen, Aonian Li, et al.2025 · 66 citations
- LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMsarXiv:2408.07055Yushi Bai, Jiajie Zhang, Xin Lv, et al.2024 · 66 citations
- A Comprehensive Survey on Long Context Language ModelingarXiv:2503.17407Jiaheng Liu, Dawei Zhu, Zhiqi Bai, et al.2025 · 64 citations
- Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language ModelingarXiv:2406.07522Liliang Ren, Yang Liu, Yadong Lu, et al.2024 · 59 citations
- The Mamba in the Llama: Distilling and Accelerating Hybrid ModelsConference on Neural Information Processing Systems (NeurIPS)Junxiong Wang; Daniele Paliotta; Avner May; Alexander M. Rush;, Tri Dao2024 · 59 citations
- Reducing Transformer Key-Value Cache Size with Cross-Layer AttentionConference on Neural Information Processing Systems (NeurIPS)William Brandon, Mayank Mishra, Aniruddha Nrusimha, et al.2024 · 57 citations
- A Survey of Efficient Reasoning for Large Reasoning Models: Language, Multimodality, and BeyondarXiv:2503.21614Xiaoye Qu, Yafu Li, Zhao-Chen Su, et al.2025 · 55 citations
- HELMET: How to Evaluate Long-Context Language Models Effectively and ThoroughlyarXiv:2410.02694Howard Yen, Tianyu Gao, Minmin Hou, et al.2024 · 55 citations
- A Survey of Resource-efficient LLM and Multimodal Foundation ModelsarXiv:2401.08092Mengwei Xu, Wangsong Yin, Dongqi Cai, et al.2024 · 54 citations
- Kimi Linear: An Expressive, Efficient Attention ArchitecturearXiv:2510.26692Kimi Team, Yu Zhang, Zongyu Lin, et al.2025 · 51 citations
- From Decoding to Meta-Generation: Inference-time Algorithms for Large Language ModelsarXiv:2406.16838Sean Welleck, Amanda Bertsch, Matthew Finlayson, et al.2024 · 51 citations
- Hymba: A Hybrid-head Architecture for Small Language ModelsarXiv:2411.13676Xin Dong, Yonggan Fu, Shizhe Diao, et al.2024 · 50 citations
- Long Context Compression with Activation BeaconarXiv:2401.03462Peitian Zhang, Zheng Liu, Shitao Xiao, et al.2024 · 47 citations
- Stable LM 2 1.6B Technical ReportarXiv:2402.17834Marco Bellagente, Jonathan Tow, Dakota Mahan, et al.2024 · 46 citations
- Long-Context Language Modeling with Parallel Context EncodingAnnual Meeting of the Association for Computational Linguistics (ACL)Howard Yen, Tianyu Gao, Danqi Chen2024 · 44 citations
- SemEval-2026 Task 13: Detecting Machine-Generated Code with Multiple Programming Languages, Generators, and Application ScenariosInternational Workshop on Semantic Evaluation (SemEval)Daniil Orel, Dilshod Azizov, Indraneil Paul, et al.2026 · 41 citations
- DeepSeek: Paradigm Shifts and Technical Evolution in Large AI ModelsarXiv:2507.09955Luolin Xiong, Haofen Wang, Xi Chen, et al.2025 · 41 citations
- Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning TasksarXiv:2402.04248Jongho Park, Jaeseung Park, Zheyang Xiong, et al.2024 · 41 citations
- LongEmbed: Extending Embedding Models for Long Context RetrievalConference on Empirical Methods in Natural Language Processing (EMNLP)Dawei Zhu, Liang Wang, Nan Yang, et al.2024 · 37 citations
- MambaByte: Token-free Selective State Space ModelarXiv:2401.13660Junxiong Wang, Tushaar Gangavarapu, Jing Nathan Yan, et al.2024 · 35 citations
- Lightning Attention-2: A Free Lunch for Handling Unlimited Sequence Lengths in Large Language ModelsarXiv:2401.04658Zhen Qin, Weigao Sun, Dong Li, et al.2024 · 31 citations
- Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of GeneralizationarXiv:2405.15071Boshi Wang, Xiang Yue, Yu Su, et al.2024 · 30 citations
- No Train No Gain: Revisiting Efficient Training Algorithms For Transformer-based Language ModelsarXiv:2307.06440Jean Kaddour, Oscar Key, Piotr Nawrot, et al.2023 · 30 citations
- JetMoE: Reaching Llama2 Performance with 0.1M DollarsarXiv:2404.07413Yikang Shen, Zhen Guo, Tianle Cai, et al.2024 · 28 citations
- Exploring the Relationship between LLM Hallucinations and Prompt Linguistic Nuances: Readability, Formality, and ConcretenessarXiv:2309.11064Vipula Rawte, Prachi Priya, S.M Towhidul Islam Tonmoy, et al.2023 · 27 citations
- Step-3 is Large yet Affordable: Model-system Co-design for Cost-effective DecodingarXiv:2507.19427StepFun, Bin Wang, Bojun Wang, et al.2025 · 26 citations
- Hunyuan-Large: An Open-Source MoE Model with 52 Billion Activated Parameters by TencentarXiv:2411.02265Xingwu Sun, Yanfeng Chen, Yiqing Huang, et al.2024 · 25 citations
- AICD Bench: A Challenging Benchmark for AI-Generated Code DetectionConference of the European Chapter of the Association for Computational Linguistics (EACL)Daniil Orel, Dilshod Azizov, Indraneil Paul, et al.2026 · 23 citations
- RWKV-7 "Goose" with Expressive Dynamic State EvolutionarXiv:2503.14456Bo Peng, Ruichong Zhang, Daniel Goldstein, et al.2025 · 23 citations
- Multimodal Needle in a Haystack: Benchmarking Long-Context Capability of Multimodal Large Language ModelsConference of the North American Chapter of the Association for Computational Linguistics (NAACL)Hengyi Wang, Haizhou Shi, Shiwei Tan, et al.2025 · 21 citations
- Astraios: Parameter-Efficient Instruction Tuning Code Large Language ModelsarXiv:2401.00788Terry Yue Zhuo, Armel Zebaze, Nitchakarn Suppattarachai, et al.2024 · 21 citations
- Counting-Stars: A Multi-evidence, Position-aware, and Scalable Benchmark for Evaluating Long-Context Large Language ModelsInternational Conference on Computational Linguistics (COLING)Mingyang Song, Mao Zheng, Xuan Luo2025 · 20 citations
- LongRecipe: Recipe for Efficient Long Context Generalization in Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Zhiyuan Hu, Yuliang Liu, Jinman Zhao, et al.2025 · 16 citations
- NESTFUL: A Benchmark for Evaluating LLMs on Nested Sequences of API CallsConference on Empirical Methods in Natural Language Processing (EMNLP)Kinjal Basu, Ibrahim Abdelaziz, Kiran Kate, et al.2025 · 16 citations
- Arctic-Text2SQL-R1: Simple Rewards, Strong Reasoning in Text-to-SQLFindings of the Association for Computational LinguisticsZhewei Yao, Guoheng Sun, Łukasz Borchmann, et al.2026 · 15 citations
- A Survey on Latent ReasoningarXiv:2507.06203Rui-Jie Zhu, Tianhao Peng, Tianhao Cheng, et al.2025 · 15 citations
- L4Q: Parameter Efficient Quantization-Aware Fine-Tuning on Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Hyesung Jeon, Yulhwa Kim, Jae-Joon Kim2025 · 15 citations
- What are the Essential Factors in Crafting Effective Long Context Multi-Hop Instruction Datasets? Insights and Best PracticesAnnual Meeting of the Association for Computational Linguistics (ACL)Zhi Chen, Qiguang Chen, Libo Qin, et al.2025 · 15 citations
- Bridging the Gap between Synthetic and Authentic Images for Multimodal Machine TranslationConference on Empirical Methods in Natural Language Processing (EMNLP)Wenyu Guo, Qingkai Fang, Dong Yu, et al.2023 · 15 citations
- QwenLong-L1: Towards Long-Context Large Reasoning Models with Reinforcement LearningarXiv:2505.17667Fanqi Wan, Weizhou Shen, Shengyi Liao, et al.2025 · 13 citations
- LADM: Long-context Training Data Selection with Attention-based Dependency Measurement for LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Jianghao Chen, Junhong Wu, Yangyifan Xu, et al.2025 · 12 citations
- Linear Attention Sequence ParallelismarXiv:2404.02882Weigao Sun, Zhen Qin, Dong Li, et al.2024 · 12 citations
- Measuring Data Diversity for Instruction Tuning: A Systematic Analysis and A Reliable MetricAnnual Meeting of the Association for Computational Linguistics (ACL)Yuming Yang, Yang Nan, Junjie Ye, et al.2025 · 11 citations
- B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading MemoryConference on Neural Information Processing Systems (NeurIPS)Luca Zancato, Arjun Seshadri, Yonatan Dukler, et al.2024 · 11 citations
- EventRL: Enhancing Event Extraction with Outcome Supervision for Large Language ModelsarXiv:2402.11430Jun Gao, Huan Zhao, Wei Wang, et al.2024 · 11 citations
- Longhorn: State Space Models are Amortized Online LearnersarXiv:2407.14207Bo Liu, Rui Wang, Lemeng Wu, et al.2024 · 11 citations
- Yi-Lightning Technical ReportarXiv:2412.01253Alan Wake, Bei Chen, C.X. Lv, et al.2024 · 11 citations
- PanGu-π: Enhancing Language Model Architectures via Nonlinearity CompensationarXiv:2312.17276Yunhe Wang, Hanting Chen, Yehui Tang, et al.2023 · 10 citations
- TriFine: A Large-Scale Dataset of Vision-Audio-Subtitle for Tri-Modal Machine Translation and Benchmark with Fine-Grained Annotated TagsInternational Conference on Computational Linguistics (COLING)Boyu Guan, Yining Zhang, Yang Zhao, et al.2025 · 9 citations
- Just read twice: closing the recall gap for recurrent language modelsarXiv:2407.05483Simran Arora; Aman Timalsina; Aaryan Singhal; Benjamin Spector; Sabri Eyuboglu; Xinyi Zhao; Ashish Rao; Atri Rudra;, Christopher Re2024 · 8 citations
- Scaling Smart: Accelerating Large Language Model Pre-training with Small Model InitializationarXiv:2409.12903Mohammad Samragh, Iman Mirzadeh, Keivan Alizadeh Vahid, et al.2024 · 8 citations
- ERNIE 5.0 Technical ReportarXiv:2602.04705Haifeng Wang, Hua Wu, Tian Wu, et al.2026 · 7 citations
- MoM: Linear Sequence Modeling with Mixture-of-MemoriesarXiv:2502.13685Jusen Du, Weigao Sun, Disen Lan, et al.2025 · 7 citations
- Glyph: Scaling Context Windows via Visual-Text CompressionAnnual Meeting of the Association for Computational Linguistics (ACL)Jiale Cheng, Yusen Liu, Xinyu Zhang, et al.2026 · 6 citations
- SuperWriter: Reflection-Driven Long-Form Generation with Large Language ModelsFindings of the Association for Computational LinguisticsYuhao Wu, Yushi Bai, Zhiqiang Hu, et al.2026 · 6 citations
- Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive TasksAnnual Meeting of the Association for Computational Linguistics (ACL)Wenqi Zhang, Mengna Wang, Gangao Liu, et al.2026 · 5 citations
- From 128K to 4M: Efficient Training of Ultra-Long Context Large Language ModelsFindings of the Association for Computational LinguisticsChejian Xu, Wei Ping, Peng Xu, et al.2026 · 5 citations
- CAFE: Retrieval Head-based Coarse-to-Fine Information Seeking to Enhance Multi-Document QA CapabilityConference on Empirical Methods in Natural Language Processing (EMNLP)Han Peng, Jinhao Jiang, Zican Dong, et al.2025 · 4 citations
- Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMsAnnual Meeting of the Association for Computational Linguistics (ACL)Binxing Xu, Hao Gu, Lujun Li, et al.2026 · 3 citations
- DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache CompressionarXiv:2609.19969DeepSeek-AI, Anyi Xu, B. Li, et al.2026 · 3 citations
- Scaling Laws for Code: A More Data-Hungry RegimeAnnual Meeting of the Association for Computational Linguistics (ACL)Xianzhen Luo, Wenzhen Zheng, Qingfu Zhu, et al.2026 · 3 citations
- Sparse Brains are Also Adaptive Brains: Cognitive-Load-Aware Dynamic Activation for LLMsFindings of the Association for Computational LinguisticsYiheng Yang, Yujie Wang, Chi Ma, et al.2026 · 3 citations
- Cross-layer Attention Sharing for Pre-trained Large Language ModelsTransactions of the Association for Computational Linguistics (TACL)Yongyu Mu, Yuzhang Wu, Yuchun Fan, et al.2026 · 2 citations
- Lizard: An Efficient Linearization Framework for Large Language ModelsAnnual Meeting of the Association for Computational Linguistics (ACL)Chien Van Nguyen, Huy Huu Nguyen, Ruiyi Zhang, et al.2026 · 2 citations
- MiniCPM-SALA: Hybridizing Sparse and Linear Attention for Efficient Long-Context ModelingarXiv:2602.11761MiniCPM Team, Wenhao An, Yingfa Chen, et al.2026 · 2 citations
- From Static Inference to Dynamic Interaction: A Survey of Streaming Large Language ModelsFindings of the Association for Computational LinguisticsJunlong Tong, Zilong Wang, YuJie Ren, et al.2026 · 1 citation
- ReAttn: Improving Attention-based Re-ranking via Attention Re-weightingFindings of the Association for Computational LinguisticsYuxing Tian, Fengran Mo, Weixu Zhang, et al.2026 · 1 citation
- StateX: Enhancing RNN Recall via Post-training State ExpansionFindings of the Association for Computational LinguisticsXingyu Shen, Yingfa Chen, Zhen Leng Thai, et al.2026 · 1 citation
- VLN-NF: Feasibility-Aware Vision-and-Language Navigation with False-Premise InstructionsAnnual Meeting of the Association for Computational Linguistics (ACL)Hung-Ting Su, Ting-Jun Wang, Jia-Fong Yeh, et al.2026 · 1 citation
- A Survey of Retentive NetworkFindings of the Association for Computational LinguisticsHaiqi Yang, Zhiyuan Li, Yi Chang, et al.2026
- Accelerating LLM Fine-Tuning via Embedding Knowledge TransferFindings of the Association for Computational LinguisticsMeishu Peng, Ziyue Zhang, Yi Zhang, et al.2026
This page in Markdown → https://md.research.elamur.ai/free/en/authors/rameswar-panda/cited-by/