From the 1 of 19 linked papers with an AI index.
19 papers
AdaMTP: An Adaptive Training Paradigm for Multi-Token Prediction
Ziqiang Cui, Han Shi, Bowei He +8
Multi-Token Prediction (MTP) has emerged as an effective paradigm that augments a shared Large Language Model backbone with auxiliary heads, training the model to predict several f…
Restoring Collaborative Signals in Semantic-ID Generative Recommendation via Personalized Natural Language
Changjiang Han, Qingyang Li, Yaqiang Zang +4
The paper introduces a framework that uses personalized natural language prompts to inject hierarchical collaborative cues into LLM‑based generative recommendation models that outp…
Less Is More: Elevating RAG via Performance-Driven Context Compression
Ziqiang Cui, Yunpeng Weng, Xing Tang +7
Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for improving the timeliness of knowledge updates and the factual accuracy of large language models. Howeve…
Beyong Tokens: Item-aware Attention for LLM-based Recommendation
Xiaokun Zhang, Bowei He, Jiamin Chen +2
Large Language Models (LLMs) have recently gained increasing attention in the field of recommendation. Existing LLM-based methods typically represent items as token sequences, and…
Learning Quantised Structure-Preserving Motion Representations for Dance Fingerprinting
Arina Kharlamova, Bowei He, Chen Ma +1
We present DANCEMATCH, an end-to-end framework for motion-based dance retrieval, the task of identifying semantically similar choreographies directly from raw video, defined as DAN…
Pedagogically-Inspired Data Synthesis for Language Model Knowledge Distillation
Bowei He, Yankai Chen, Xiaokun Zhang +4
Knowledge distillation from Large Language Models (LLMs) to smaller models has emerged as a critical technique for deploying efficient AI systems. However, current methods for dist…