Improving Weak-to-Strong Generalization with Reliability-Aware Alignment

Yue Guo, Yi Yang

Large language models (LLMs) are now rapidly advancing and surpassing human abilities on many natural language tasks. However, aligning these super-human LLMs with human knowledge…