1 citations · 3 across the 11 of their papers we have counts for
12 papers
When Vision Becomes Text: Visual Token Pruning via Cross-Modal Residual Guidance in VLMs
Congyang Ou, Ruike Song, Yang Zhou +3
Abundant visual information strengthens vision-language model (VLM) perception, yet massive visual tokens raise inference costs. Existing visual token pruning methods rely on simil…
Regularize or Localize: When Training-Time KV-Cache Geometry Pays Under Quantization
Libo Sun, Po-Wei Harn, Zewei Zhang +2
We study whether \sigreg -- LeJEPA's anti-collapse objective -- can reshape representations during standard autoregressive language-model pretraining, and when the resulting geomet…
Retrieval-Warmed Energy-Based Reasoning: A Five-Arm Ablation Methodology for Diffusion-as-Inference on Structured Reasoning Tasks
Libo Sun, Po-Wei Harn, Zewei Zhang +2
Warm-started diffusion samplers accelerate iterative inference, but it is rarely clear which part of the pipeline carries the gain. We study \textbf{retrieval-warmed energy-based r…
Minimal-Intervention KV Retention via Set-Conditioned Diversity
Libo Sun, Po-wei Harn, Peixiong He +1
KV-cache compression at small budgets is a crowded design space spanning cache representation, head-wise routing, compression cadence, decoding behavior, and within-budget scoring.…
When Does Sparse MoE Help in Vision? The Role of Backbone Compute Leverage in Sparse Routing
Libo Sun, Po-wei Harn, Peixiong He +1
Mixture-of-Experts (MoE) networks promise favorable accuracy-compute trade-offs, yet practical vision deployments are hindered by expert collapse and limited end-to-end efficiency…
MoE-nD: Per-Layer Mixture-of-Experts Routing for Multi-Axis KV Cache Compression
Libo Sun, Peixiong He, Po-Wei Harn +1
KV cache memory is the dominant bottleneck for long-context LLM inference. Existing compression methods each act on a single axis of the four-dimensional KV tensor -- token evictio…
MAGNET: Towards Adaptive GUI Agents with Memory-Driven Knowledge Evolution
Libo Sun, Jiwen Zhang, Siyuan Wang +1
Mobile GUI agents powered by large foundation models enable autonomous task execution, but frequent updates altering UI appearance and reorganizing workflows cause agents trained o…
SocioVerse: A World Model for Social Simulation Powered by LLM Agents and A Pool of 10 Million Real-World Users
Xinnong Zhang, Jiayu Lin, Xinyi Mou +18
Social simulation is transforming traditional social science research by modeling human behavior through interactions between virtual individuals and their environments. With recen…
From Individual to Society: A Survey on Social Simulation Driven by Large Language Model-based Agents
Xinyi Mou, Xuanwen Ding, Qi He +8
Traditional sociological research often relies on human participation, which, though effective, is expensive, challenging to scale, and with ethical concerns. Recent advancements i…
ElectionSim: Massive Population Election Simulation Powered by Large Language Model Driven Agents
Xinnong Zhang, Jiayu Lin, Libo Sun +10
The massive population election simulation aims to model the preferences of specific groups in particular election scenarios. It has garnered significant attention for its potentia…
AI-Press: A Multi-Agent News Generating and Feedback Simulation System Powered by Large Language Models
Xiawei Liu, Shiyue Yang, Xinnong Zhang +6
The rise of various social platforms has transformed journalism. The growing demand for news content has led to the increased use of large language models (LLMs) in news production…
Identity-Driven Hierarchical Role-Playing Agents
Libo Sun, Siyuan Wang, Xuanjing Huang +1
Utilizing large language models (LLMs) to achieve role-playing has gained great attention recently. The primary implementation methods include leveraging refined prompts and fine-t…