8 papers
Deployment-Time Memorization in Foundation-Model Agents
Lei, Chen, Guilin Zhang +8
Foundation-model agents are increasingly long-lived systems that remember users across interactions, making memorization an explicit deployment-time function rather than solely a p…
From Rigid to Dynamic: Entropy-Guided Adaptive Inference for Long-Context LLMs
Zhanchao Xu, Haoyang Li, Qingfa Xiao +4
Existing sparse attention and KV cache compression methods for long-context LLM inference typically apply fixed sparsity patterns or uniform budgets across all attention heads, ove…
AGRAG: Advanced Graph-based Retrieval-Augmented Generation for LLMs
Yubo Wang, Haoyang Li, Fei Teng +1
Graph-based retrieval-augmented generation (Graph-based RAG) has demonstrated significant potential in enhancing Large Language Models (LLMs) with structured knowledge. However, ex…
GORAG: Graph-based Online Retrieval Augmented Generation for Dynamic Few-shot Social Media Text Classification
Yubo Wang, Haoyang Li, Fei Teng +1
Text classification is vital for Web for Good applications like hate speech and misinformation detection. However, traditional models (e.g., BERT) often fail in dynamic few-shot se…
LLMLog: Advanced Log Template Generation via LLM-driven Multi-Round Annotation
Fei Teng, Haoyang Li, Lei Chen
Modern computing systems, such as HDFS and Spark, produce vast quantities of logs that developers use for tasks like anomaly detection and error analysis. To simplify log analysis,…
Understanding the Embedding Models on Hyper-relational Knowledge Graph
Yubo Wang, Shimin Di, Zhili Wang +4
Recently, Hyper-relational Knowledge Graphs (HKGs) have been proposed as an extension of traditional Knowledge Graphs (KGs) to better represent real-world facts with additional qua…