18 papers
Reasoning Errors Have a Region and a Direction in the Residual-Stream Trajectory of LLMs
Hamed Damirchi, Ignacio Meza De la Jara, Damith Ranasinghe +2
As language models are increasingly used for tasks that require verifiable reasoning, reliably distinguishing sound reasoning from flawed reasoning has become an important practica…
Link prediction on multi-relational graphs from an influence propagation perspective
Zidu Yin, Yuankai Qi, Dong Gong +3
Predicting the existence and type of links (edges) between nodes in a multi-relational graph is key for applications from social interaction prediction to knowledge relationship id…
On the Identifiability of Masked Prediction: Mode Blindness and Mask Schedules
Yichao Cai, Javen Qinfeng Shi
Masked prediction learns representations by fitting a schedule-weighted family of conditional laws, but it remains unclear when near-optimal conditional prediction pins down the un…
Boundary Embedding Shaping with Adaptive Contrastive Learning for Graph Structural Disentanglement
Jiaqing Chen, Zidu Yin, Yichao Cai +4
Graph neural networks (GNNs) excel at aggregating neighbor information for classification, yet their performance is hindered by graph structural entanglement, where spurious correl…
The Geometric Mechanics of Contrastive Representation Learning: Alignment Potentials, Entropic Dispersion, and Cross-modal Divergence
Yichao Cai, Zhen Zhang, Yuhang Liu +1
While InfoNCE underlies modern contrastive learning, its geometric mechanisms remain under-characterized beyond the canonical alignment--uniformity decomposition. We develop a meas…
Learning Latent Dynamical Causal Processes for Single-Cell Perturbation Prediction
Wenkang Jiang, Yuhang Liu, Erdun Gao +3
Single-cell perturbation prediction aims to infer how cells respond to unseen interventions and to achieve out-of-distribution (OOD) generalization, providing a computational route…