4 papers · 1 filter
Robust Reasoning via Dynamic Token Selection for Distribution-Aligned Self-Distillation
Ruiqi Zhang, Lingxiang Wang, Hainan Zhang Zhiming Zheng
Self-distillation improves learning efficiency by rewriting reference answers as training data that better matches the model's own distribution. However, reference answers also int…
From Unfamiliar to Familiar: Detecting Pre-training Data via Gradient Deviations in Large Language Models
Ruiqi Zhang, Lingxiang Wang, Hainan Zhang +2
Pre-training data detection for LLMs is essential for addressing copyright concerns and mitigating benchmark contamination. Existing methods mainly focus on the likelihood-based st…
LocalSUG: City-Preference-Enhanced LLM for Query Suggestion in Local-Life Services
Jinwen Chen, Shiwen Zhang, Shuai Gong +6
In local-life service platforms, query suggestion reduces user effort by generating candidate queries from input prefixes. Traditional multi-stage systems rely heavily on historica…
FedDTRE: Federated Dialogue Generation Models Powered by Trustworthiness Evaluation
Shule Lu, Lingxiang Wang, Sijia Wen +2
With the rapid development of artificial intelligence, dialogue systems have become a prominent form of human-computer interaction. However, traditional centralized or fully local…