5 papers · 1 filter
Enhancing Multimodal Large Language Models for Ancient Chinese Character Evolution Analysis via Glyph-Driven Fine-Tuning
Rui Song, Lida Shi, Ruihua Qi +2
In recent years, rapid advances in Multimodal Large Language Models (MLLMs) have increasingly stimulated research on ancient Chinese scripts. As the evolution of written characters…
AncientBench: Towards Comprehensive Evaluation on Excavated and Transmitted Chinese Corpora
Zhihan Zhou, Daqian Shi, Rui Song +3
Comprehension of ancient texts plays an important role in archaeology and understanding of Chinese history and civilization. The rapid development of large language models needs be…
InteChar: A Unified Oracle Bone Character List for Ancient Chinese Language Modeling
Xiaolei Diao, Zhihan Zhou, Lida Shi +4
Constructing historical language models (LMs) plays a crucial role in aiding archaeological provenance studies and understanding ancient cultures. However, existing resources prese…
Shortcut Learning in In-Context Learning: A Survey
Rui Song, Yingji Li, Lida Shi +2
Shortcut learning refers to the phenomenon where models employ simple, non-robust decision rules in practical tasks, which hinders their generalization and robustness. With the rap…
Self-supervised Preference Optimization: Enhance Your Language Model with Preference Degree Awareness
Jian Li, Haojing Huang, Yujia Zhang +6
Recently, there has been significant interest in replacing the reward model in Reinforcement Learning with Human Feedback (RLHF) methods for Large Language Models (LLMs), such as D…