activity
20242026
most citedExtending Llama-3's Context Ten-Fold Overnight

4 citations · 8 across the 9 of their papers we have counts for

collaborators
Showing cs.CLShow all

5 papers · 1 filter

cs.CL2026★ 1 cited

The Devil Behind Moltbook: Anthropic Safety is Always Vanishing in Self-Evolving AI Societies

Chenxu Wang, Chaozhuo Li, Songyang Liu +10

The emergence of multi-agent systems built from large language models (LLMs) offers a promising paradigm for scalable collective intelligence and self-evolution. Ideally, such syst…

cs.CL2025

Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models

Chaozhuo Li, Pengbo Wang, Chenxu Wang +7

Edgar Allan Poe noted, "Truth often lurks in the shadow of error," highlighting the deep complexity intrinsic to the interplay between truth and falsehood, notably under conditions…

cs.CL2024★ 1 cited

Compressing Lengthy Context With UltraGist

Peitian Zhang, Zheng Liu, Shitao Xiao +3

Compressing lengthy context is a critical but technically challenging problem. In this paper, we propose a new method called UltraGist, which is distinguished for its high-quality…

cs.CL2024★ 4 cited

Extending Llama-3's Context Ten-Fold Overnight

Peitian Zhang, Ninglu Shao, Zheng Liu +4

We extend the context length of Llama-3-8B-Instruct from 8K to 80K via QLoRA fine-tuning. The entire training cycle is super efficient, which takes 8 hours on one 8xA800 (80G) GPU…

cs.CL2024★ 2 cited

Long Context Compression with Activation Beacon

Peitian Zhang, Zheng Liu, Shitao Xiao +3

Long context compression is a critical research problem due to its significance in reducing the high computational and memory costs associated with LLMs. In this paper, we propose…