14 citations · 34 across the 9 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.CV2024
Synth4Seg -- Learning Defect Data Synthesis for Defect Segmentation using Bi-level Optimization
Shancong Mou, Raviteja Vemulapalli, Shiyu Li +8
Defect segmentation is crucial for quality control in advanced manufacturing, yet data scarcity poses challenges for state-of-the-art supervised deep learning. Synthetic defect dat…
cs.CL2024
TIS-DPO: Token-level Importance Sampling for Direct Preference Optimization With Estimated Weights
Aiwei Liu, Haoping Bai, Zhiyun Lu +9
Direct Preference Optimization (DPO) has been widely adopted for preference alignment of Large Language Models (LLMs) due to its simplicity and effectiveness. However, DPO is deriv…
cs.CL2024
Direct Large Language Model Alignment Through Self-Rewarding Contrastive Prompt Distillation
Aiwei Liu, Haoping Bai, Zhiyun Lu +5
Aligning large language models (LLMs) with human expectations without human-annotated preference data is an important problem. In this paper, we propose a method to evaluate the re…