Tuna: Instruction Tuning using Feedback from Large Language Models

Haoran Li, Yiran Liu, Xingxing Zhang +2

Instruction tuning of open-source large language models (LLMs) like LLaMA, using direct outputs from more powerful LLMs such as Instruct-GPT and GPT-4, has proven to be a cost-effe…