6 papers
MinkowskiPE: Minkowski Positional Encoding for Spatiotemporal Perception
Yuhao Li, Louie Hong Yao, Tianyi Shi +4
Modeling spatiotemporal coupling is a key challenge in building physical intelligence across scales, from microscopic to macroscopic. Existing models capture such structure broadly…
Cross-Lingual Steering for Figurative Language Generation
Linfeng Liu, Tiffany Zhan, Louie Hong Yao +2
Cross-lingual activation steering has been studied mainly for language-agnostic properties such as factual knowledge and reasoning. Its transferability remains unclear for figurati…
Rhetorical Questions in LLM Representations: A Linear Probing Study
Louie Hong Yao, Vishesh Anand, Yuan Zhuang +1
Rhetorical questions are asked not to seek information but to persuade or signal stance. How large language models internally represent them remains unclear. We analyze rhetorical…
A Minimal Model of Representation Collapse: Frustration, Stop-Gradient, and Dynamics
Louie Hong Yao, Yuhao Li, Shengchao Liu
Self-supervised representation learning is central to modern machine learning because it extracts structured latent features from unlabeled data and enables robust transfer across…
JE-IRT: A Geometric Lens on LLM Abilities through Joint Embedding Item Response Theory
Louie Hong Yao, Nicholas Jarvis, Tiffany Zhan +3
Standard LLM evaluation practices compress diverse abilities into single scores, obscuring their inherently multidimensional nature. We present JE-IRT, a geometric item-response fr…
Towards Robust Evaluation of Visual Activity Recognition: Resolving Verb Ambiguity with Sense Clustering
Louie Hong Yao, Nicholas Jarvis, Tianyu Jiang
Evaluating visual activity recognition systems is challenging due to inherent ambiguities in verb semantics and image interpretation. When describing actions in images, synonymous…