activity
20232025
most citedLifelong Learning of Large Language Model based Agents: A Roadmap

4 citations · 10 across the 14 of their papers we have counts for

collaborators
Showing cs.LGShow all

8 papers · 1 filter

cs.LG2025

Neural-Symbolic Message Passing with Dynamic Pruning

Chongzhi Zhang, Junhao Zheng, Zhiping Peng +1

Complex Query Answering (CQA) over incomplete Knowledge Graphs (KGs) is a challenging task. Recently, a line of message-passing-based research has been proposed to solve CQA. Howev…

cs.LG2025

Spurious Forgetting in Continual Learning of Language Models

Junhao Zheng, Xidi Cai, Shengjie Qiu +1

Recent advancements in large language models (LLMs) reveal a perplexing phenomenon in continual learning: despite extensive training, models experience significant performance decl…

cs.LG2024

Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering

Chongzhi Zhang, Zhiping Peng, Junhao Zheng +3

Complex Logical Query Answering (CLQA) over incomplete knowledge graphs is a challenging task. Recently, Query Embedding (QE) methods are proposed to solve CLQA by performing multi…

cs.LG2024★ 1 cited

Towards Lifelong Learning of Large Language Models: A Survey

Junhao Zheng, Shengjie Qiu, Chengming Shi +1

As the applications of large language models (LLMs) expand across diverse fields, the ability of these models to adapt to ongoing changes in data, tasks, and user preferences becom…

cs.LG2024★ 1 cited

Balancing the Causal Effects in Class-Incremental Learning

Junhao Zheng, Ruiyan Wang, Chongzhi Zhang +2

Class-Incremental Learning (CIL) is a practical and challenging problem for achieving general artificial intelligence. Recently, Pre-Trained Models (PTMs) have led to breakthroughs…

cs.LG2024

Conditional Logical Message Passing Transformer for Complex Query Answering

Chongzhi Zhang, Zhiping Peng, Junhao Zheng +1

Complex Query Answering (CQA) over Knowledge Graphs (KGs) is a challenging task. Given that KGs are usually incomplete, neural models are proposed to solve CQA by performing multi-…

cs.LG2024★ 1 cited

Can LLMs Learn New Concepts Incrementally without Forgetting?

Junhao Zheng, Shengjie Qiu, Qianli Ma

Large Language Models (LLMs) have achieved remarkable success across various tasks, yet their ability to learn incrementally without forgetting remains underexplored. Incremental l…

cs.LG2024★ 2 cited

Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer

Junhao Zheng, Qianli Ma, Zhen Liu +2

Multimodal Continual Instruction Tuning (MCIT) enables Multimodal Large Language Models (MLLMs) to meet continuously emerging requirements without expensive retraining. MCIT faces…