5 papers · 1 filter
RM-Distiller: Exploiting Generative LLM for Reward Model Distillation
Hongli Zhou, Hui Huang, Wei Liu +8
Reward models (RMs) play a pivotal role in aligning large language models (LLMs) with human preferences. Due to the difficulty of obtaining high-quality human preference annotation…
Cross-Domain Bilingual Lexicon Induction via Pretrained Language Models
Qiuyu Ding, Zhiqiang Cao, Hailong Cao +1
Bilingual Lexicon Induction (BLI) is generally based on common domain data to obtain monolingual word embedding, and by aligning the monolingual word embeddings to obtain the cross…
Enhancing Large Language Models'Machine Translation via Dynamic Focus Anchoring
Qiuyu Ding, Zhiqiang Cao, Hailong Cao +1
Large language models have demonstrated exceptional performance across multiple crosslingual NLP tasks, including machine translation (MT). However, persistent challenges remain in…
Speculative Decoding Meets Quantization: Compatibility Evaluation and Hierarchical Framework Design
Yudi Zhang, Weilin Zhao, Xu Han +4
Speculative decoding and quantization effectively accelerate memory-bound inference of large language models. Speculative decoding mitigates the memory bandwidth bottleneck by veri…
Dual Instruction Tuning with Large Language Models for Mathematical Reasoning
Yongwei Zhou, Tiejun Zhao
Recent advancements highlight the success of instruction tuning with large language models (LLMs) utilizing Chain-of-Thought (CoT) data for mathematical reasoning tasks. Despite th…