Synergistic Weak-Strong Collaboration by Aligning Preferences

Yizhu Jiao, Xuchao Zhang, Zhaoyang Wang +7

Current Large Language Models (LLMs) excel in general reasoning yet struggle with specialized tasks requiring proprietary or domain-specific knowledge. Fine-tuning large models for…