4 citations · 10 across the 14 of their papers we have counts for
14 papers
LifelongAgentBench: Evaluating LLM Agents as Lifelong Learners
Junhao Zheng, Xidi Cai, Qiuke Li +5
Lifelong learning is essential for intelligent agents operating in dynamic environments. Current large language model (LLM)-based agents, however, remain stateless and unable to ac…
Neural-Symbolic Message Passing with Dynamic Pruning
Chongzhi Zhang, Junhao Zheng, Zhiping Peng +1
Complex Query Answering (CQA) over incomplete Knowledge Graphs (KGs) is a challenging task. Recently, a line of message-passing-based research has been proposed to solve CQA. Howev…
Spurious Forgetting in Continual Learning of Language Models
Junhao Zheng, Xidi Cai, Shengjie Qiu +1
Recent advancements in large language models (LLMs) reveal a perplexing phenomenon in continual learning: despite extensive training, models experience significant performance decl…
ListConRanker: A Contrastive Text Reranker with Listwise Encoding
Junlong Liu, Yue Ma, Ruihui Zhao +3
Reranker models aim to re-rank the passages based on the semantics similarity between the given query and passages, which have recently received more attention due to the wide appl…
Lifelong Learning of Large Language Model based Agents: A Roadmap
Junhao Zheng, Chengming Shi, Xidi Cai +5
Lifelong learning, also known as continual or incremental learning, is a crucial component for advancing Artificial General Intelligence (AGI) by enabling systems to continuously a…
Pathformer: Recursive Path Query Encoding for Complex Logical Query Answering
Chongzhi Zhang, Zhiping Peng, Junhao Zheng +3
Complex Logical Query Answering (CLQA) over incomplete knowledge graphs is a challenging task. Recently, Query Embedding (QE) methods are proposed to solve CLQA by performing multi…
Towards Lifelong Learning of Large Language Models: A Survey
Junhao Zheng, Shengjie Qiu, Chengming Shi +1
As the applications of large language models (LLMs) expand across diverse fields, the ability of these models to adapt to ongoing changes in data, tasks, and user preferences becom…
Self-Adaptive Reconstruction with Contrastive Learning for Unsupervised Sentence Embeddings
Junlong Liu, Xichen Shang, Huawen Feng +2
Unsupervised sentence embeddings task aims to convert sentences to semantic vector representations. Most previous works directly use the sentence representations derived from pretr…
Balancing the Causal Effects in Class-Incremental Learning
Junhao Zheng, Ruiyan Wang, Chongzhi Zhang +2
Class-Incremental Learning (CIL) is a practical and challenging problem for achieving general artificial intelligence. Recently, Pre-Trained Models (PTMs) have led to breakthroughs…
Conditional Logical Message Passing Transformer for Complex Query Answering
Chongzhi Zhang, Zhiping Peng, Junhao Zheng +1
Complex Query Answering (CQA) over Knowledge Graphs (KGs) is a challenging task. Given that KGs are usually incomplete, neural models are proposed to solve CQA by performing multi-…
Incremental Sequence Labeling: A Tale of Two Shifts
Shengjie Qiu, Junhao Zheng, Zhen Liu +2
The incremental sequence labeling task involves continuously learning new classes over time while retaining knowledge of the previous ones. Our investigation identifies two signifi…
Can LLMs Learn New Concepts Incrementally without Forgetting?
Junhao Zheng, Shengjie Qiu, Qianli Ma
Large Language Models (LLMs) have achieved remarkable success across various tasks, yet their ability to learn incrementally without forgetting remains underexplored. Incremental l…
Beyond Anti-Forgetting: Multimodal Continual Instruction Tuning with Positive Forward Transfer
Junhao Zheng, Qianli Ma, Zhen Liu +2
Multimodal Continual Instruction Tuning (MCIT) enables Multimodal Large Language Models (MLLMs) to meet continuously emerging requirements without expensive retraining. MCIT faces…
Learn or Recall? Revisiting Incremental Learning with Pre-trained Language Models
Junhao Zheng, Shengjie Qiu, Qianli Ma
Incremental Learning (IL) has been a long-standing problem in both vision and Natural Language Processing (NLP) communities. In recent years, as Pre-trained Language Models (PLMs)…