activity
20232026
most citedSparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers

3 citations · 7 across the 14 of their papers we have counts for

collaborators

14 papers

cs.SD2026

AuK Technical Report: An Open-Source Foundational Model for Speech Generation and Editing

Ziyang Ma, Zhikang Niu, Wenming Tu +30

We introduce AuK, an open-source foundational model that unifies speech generation and editing through a common interface of natural-language instructions and audio context. To sup…

cs.AI2026

Xetrieval: Explaining Dense Retrieval through Feature Elicitation

Zhixin Cai, Jun Bai, Yang Liu +7

Dense retrieval enables effective semantic matching, yet the semantic factors underlying its relevance scores remain opaque. Sparse autoencoders (SAEs) support feature-level explan…

cs.LG2026

$OneMillion-Bench: How Far are Language Agents from Human Experts?

Qianyu Yang, Yang Liu, Jiaqi Li +19

As language models (LMs) evolve from chat assistants to long-horizon agents capable of multi-step reasoning and tool use, existing benchmarks remain largely confined to structured…

cs.HC2026

NarrativeLoom: Enhancing Creative Storytelling through Multi-Persona Collaborative Improvisation

Yuxi Ma, Yongqian Peng, Fengyuan Yang +5

Large Language Models show promise for AI-assisted storytelling, yet current tools often generate predictable, unoriginal narratives. To address this limitation, we present Narrati…

cs.LG2025

Adaptive Preference Optimization with Uncertainty-aware Utility Anchor

Xiaobo Wang, Zixia Jia, Jiaqi Li +2

Offline preference optimization methods are efficient for large language models (LLMs) alignment. Direct Preference optimization (DPO)-like learning, one of the most popular approa…

cs.CL2025

Understanding and Leveraging the Expert Specialization of Context Faithfulness in Mixture-of-Experts LLMs

Jun Bai, Minghao Tong, Yang Liu +2

Context faithfulness is essential for reliable reasoning in context-dependent scenarios. However, large language models often struggle to ground their outputs in the provided conte…

cs.IR2025★ 1 cited

TongSearch-QR: Reinforced Query Reasoning for Retrieval

Xubo Qin, Jun Bai, Jiaqi Li +2

Traditional information retrieval (IR) methods excel at textual and semantic matching but struggle in reasoning-intensive retrieval tasks that require multi-hop inference or comple…

cs.AI2025

ReflectEvo: Improving Meta Introspection of Small LLMs by Learning Self-Reflection

Jiaqi Li, Xinyi Dong, Yang Liu +6

We present a novel pipeline, ReflectEvo, to demonstrate that small language models (SLMs) can enhance meta introspection through reflection learning. This process iteratively gener…

cs.CL2024★ 3 cited

Sparser is Faster and Less is More: Efficient Sparse Attention for Long-Range Transformers

Chao Lou, Zixia Jia, Zilong Zheng +1

Accommodating long sequences efficiently in autoregressive Transformers, especially within an extended context window, poses significant challenges due to the quadratic computation…

cs.CL2024

LangSuitE: Planning, Controlling and Interacting with Large Language Models in Embodied Text Environments

Zixia Jia, Mengmeng Wang, Baichen Tong +2

Recent advances in Large Language Models (LLMs) have shown inspiring achievements in constructing autonomous agents that rely on language descriptions as inputs. However, it remain…

cs.CL2024

Combining Supervised Learning and Reinforcement Learning for Multi-Label Classification Tasks with Partial Labels

Zixia Jia, Junpeng Li, Shichuan Zhang +2

Traditional supervised learning heavily relies on human-annotated datasets, especially in data-hungry neural approaches. However, various tasks, especially multi-label tasks like d…

cs.CL2024★ 1 cited

Potential and Limitations of LLMs in Capturing Structured Semantics: A Case Study on SRL

Ning Cheng, Zhaohui Yan, Ziming Wang +6

Large Language Models (LLMs) play a crucial role in capturing structured semantics to enhance language understanding, improve interpretability, and reduce bias. Nevertheless, an on…

cs.CL2023★ 1 cited

Semi-automatic Data Enhancement for Document-Level Relation Extraction with Distant Supervision from Large Language Models

Junpeng Li, Zixia Jia, Zilong Zheng

Document-level Relation Extraction (DocRE), which aims to extract relations from a long context, is a critical challenge in achieving fine-grained structural comprehension and gene…

cs.CL2023★ 1 cited

LooGLE: Can Long-Context Language Models Understand Long Contexts?

Jiaqi Li, Mengmeng Wang, Zilong Zheng +1

Large language models (LLMs), despite their impressive performance in various language tasks, are typically limited to processing texts within context-window size. This limitation…