4 papers
Similar Models Learn Differently: Final-Window Pretraining Shapes Post-Training Beyond SFT
Cen Lu, Yung-Chen Tang, Andrea Cavallaro
Developers judge a model checkpoint by how it behaves. After supervised fine-tuning (SFT), two checkpoints that perform about the same across relevant benchmarks are treated as int…
Sparse Neuron Ablation Triggers Catastrophic Collapse of the Language Core in Large Vision-Language Models
Cen Lu, Yung-Chen Tang, Andrea Cavallaro
Large Vision-Language Models (LVLMs) have shown impressive multimodal understanding capabilities, yet the structures that sustain their functionality remain poorly understood from…
Metric-Aware Hybrid Forecasting for the CTF4Science Lorenz Challenge
Cen Lu
We describe our approach to the CTF4Science Lorenz challenge, a benchmark that mixes short-horizon forecasting, long-time distribution matching, and trajectory reconstruction acros…
Analyzing Nobel Prize Literature with Large Language Models
Zhenyuan Yang, Zhengliang Liu, Jing Zhang +19
This study examines the capabilities of advanced Large Language Models (LLMs), particularly the o1 model, in the context of literary analysis. The outputs of these models are compa…