Jie Zhou · page 2
Papers
- Investigating Forgetting in Pre-Trained Representations Through Continual Learning (2023 · 10 citations)
When a pre-trained language model is fine-tuned on a sequence of tasks, its contextualized representations shift. - Cross-layer Attention Sharing for Pre-trained Large Language Models (2026 · 2 citations)
Earlier work on making LLM attention more efficient mostly targets redundancy inside a layer, for example by compressing the KV cache or grouping heads. - LLM-KT: Enhancing Large Language Models with Knowledge Tracing via Multi-Level Plug-and-Play Alignment (2026 · 1 citation)
Knowledge Tracing (KT) estimates whether a learner will solve the next exercise from their earlier answers. - PsychEval: A Multi-Session and Multi-Therapy Benchmark for High-Realism AI Psychological Counselor (2026 · 1 citation)
Most benchmarks for AI mental-health assistants test isolated, single-turn exchanges. Real counseling, by contrast, unfolds over many sessions, depends on remembering the client's history, and often mixes therapeutic schools. PsychEval addresses this gap with a Chinese-language benchmark built by using LLMs (e.g.… - TamEdit: Trajectory-Aware Meta-Learning for Specificity-Preserving Continual Knowledge Editing (2026 · 1 citation)
The paper tackles a weakness of continual knowledge editing in large language models. When many factual updates are applied one after another, existing editors compute each change on its own, and unrelated knowledge gradually degrades. The authors call this specificity drift. They propose TamEdit, which treats a… - UltraEval-Audio: A Unified Framework for Comprehensive Evaluation of Audio Foundation Models (2026 · 1 citation)
Evaluating audio foundation models (AFMs) is difficult because benchmarks and evaluation code are scattered across sources. - FeedTrans: Enhance Machine Translation via Feedback (2026)
Reinforcement learning (RL) for machine translation usually rewards a model only for what it can already produce. - More Than Sum of Its Parts: Deciphering Intent Shifts in Multimodal Hate Speech Detection (2026)
The paper addresses implicit multimodal hate speech, where a text and an image look harmless on their own but turn hateful together. - ReFreeKV: Towards Threshold-Free KV Cache Compression (2026)
KV cache pruning methods such as H2O, SnapKV and CAKE can cut LLM inference memory with little loss, but only when the cache budget is tuned to each dataset or domain.
This page in Markdown → https://md.research.elamur.ai/free/en/authors/jie-zhou/page/2/