15 papers
Discrete Diffusion Models: A Unified Framework from Tokenization to Generation
Ye Yuan, Weien Li, Rui Song +20
Discrete denoising diffusion models (DDMs) have recently emerged as a compelling alternative to autoregressive (AR) modeling for discrete data, offering parallel generation and ite…
Integrating Reasoning and Generalization in Text-to-SQL via Self-Enhanced Fine-Tuning
Feng Lyu, Jinfeng Cen, Sijing Duan +4
Text-to-SQL aims to translate natural language questions into executable SQL queries over structured databases, enabling non-expert users to access data intuitively. While recent a…
NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoning
Feng Lyu, Huiqin Yan, Sijing Duan +5
The rapid updates of online news make tracking event developments challenging, highlighting the need for timeline summarization (TLS). Hallucinations, where LLM-generated content d…
Herculean: An Agentic Benchmark for Financial Intelligence
Xueqing Peng, Zhuohan Xie, Yupeng Cao +60
As AI agents advance, the central question is no longer whether they can solve isolated financial tasks, but whether their capabilities generalize across complete professional work…
Support-Proximity Augmented Diffusion Estimation for Offline Black-Box Optimization
Yonghan Yang, Ye Yuan, Zipeng Sun +5
Offline black-box optimization aims to discover novel designs with high property scores using only a static dataset, a task fundamentally challenged by the out-of-distribution (OOD…
MINER: Mining Multimodal Internal Representation for Efficient Retrieval
Weien Li, Rui Song, Zeyu Li +8
Visual document retrieval has become essential for accessing information in visually rich documents. Existing approaches fall into two camps. Late-interaction retrievers achieve st…
Preference Heads in Large Language Models: A Mechanistic Framework for Interpretable Personalization
Weixu Zhang, Ye Yuan, Changjiang Han +7
Large Language Models (LLMs) exhibit strong implicit personalization ability, yet most existing approaches treat this behavior as a black box, relying on prompt engineering or fine…
Context-Fidelity Boosting: Enhancing Faithful Generation through Watermark-Inspired Decoding
Weixu Zhang, Fanghua Ye, Qiang Gao +7
Large language models (LLMs) often produce content that contradicts or overlooks information provided in the input context, a phenomenon known as faithfulness hallucination. In thi…
LLM Safety From Within: Detecting Harmful Content with Internal Representations
Difan Jiao, Yilun Liu, Ye Yuan +4
Guard models are widely used to detect harmful content in user prompts and LLM responses. However, state-of-the-art guard models rely solely on terminal-layer representations and o…
Give Users the Wheel: Towards Promptable Recommendation Paradigm
Fuyuan Lyu, Chenglin Luo, Qiyuan Zhang +6
Conventional sequential recommendation models have achieved remarkable success in mining implicit behavioral patterns. However, these architectures remain structurally blind to exp…
Optimizing User Profiles via Contextual Bandits for Retrieval-Augmented LLM Personalization
Linfeng Du, Ye Yuan, Zichen Zhao +8
Large language models (LLMs) excel at general-purpose tasks, yet adapting their responses to individual users remains challenging. Retrieval augmentation provides a lightweight alt…
Audio Prototypical Network For Controllable Music Recommendation
Fırat Öncel, Emiliano Penaloza, Haolun Wu +4
Traditional recommendation systems represent user preferences in dense representations obtained through black-box encoder models. While these models often provide strong recommenda…
Timing is Important: Risk-aware Fund Allocation based on Time-Series Forecasting
Fuyuan Lyu, Linfeng Du, Yunpeng Weng +6
Fund allocation has been an increasingly important problem in the financial domain. In reality, we aim to allocate the funds to buy certain assets within a certain future period. N…
Logits are All We Need to Adapt Closed Models
Gaurush Hiranandani, Haolun Wu, Subhojyoti Mukherjee +1
Many commercial Large Language Models (LLMs) are often closed-source, limiting developers to prompt tuning for aligning content generation with specific applications. While these m…
TEARS: Textual Representations for Scrutable Recommendations
Emiliano Penaloza, Olivier Gouvert, Haolun Wu +1
Traditional recommender systems rely on high-dimensional (latent) embeddings for modeling user-item interactions, often resulting in opaque representations that lack interpretabili…