8 papers
First-Passage Prediction of Grokking Delay: ACalibrated Law under AdamW with Causal Validation
Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung +1
We give the first quantitative prediction of grokking delay under AdamW. Treating the delay as a first-passage time, we derive a closed-form law T_grok - T_mem = (1 / 2 kappa_LL et…
Spectral Entropy Collapse as a Phase Transition in Delayed Generalisation: An Interventional and Predictive Framework for Grokkin
Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung +1
Grokking - the delayed transition from memorisation to generalisation in neural networks - remains poorly understood. We study this phenomenon through the geometry of learned repre…
The Norm-Separation Delay Law of Grokking: A First-Principles Theory of Delayed Generalization
Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung +1
Grokking -- the sudden generalisation that appears long after a model has perfectly memorised its training data -- has been widely observed but lacks a quantitative theory explaini…
Detecting Neurovascular Instability from Multimodal Physiological Signals Using Wearable-Compatible Edge AI: A Responsible Computational Framework
Truong Quynh Hoa, Hoang Dinh Cuong, Truong Xuan Khanh
We propose Melaguard, a multimodal ML framework (Transformer-lite, 1.2M parameters, 4-head self-attention) for detecting neurovascular instability (NVI) from wearable-compatible ph…
Entropy Collapse: A Universal Failure Mode of Intelligent Systems
Truong Xuan Khanh, Truong Quynh Hoa
A foundational assumption in complex-system collapse studies is that critical transitions are second-order, preceded by early-warning signals like rising autocorrelation, variance,…
Norm-Hierarchy Transitions in Representation Learning: When and Why Neural Networks Abandon Shortcuts
Truong Xuan Khanh, Truong Quynh Hoa
Neural networks often rely on spurious shortcuts for many epochs before discovering structured representations. However, the mechanism governing when this transition occurs and whe…