11 papers
Beyond Coordinate Gauge: An Audited Protocol for Detecting Donor-Specific Functional Fingerprints after Neural Collapse
Truong Xuan Khanh, Phan Thanh Duc
Independently trained neural networks have no shared neuron-index reference frame, so comparing them requires accounting for coordinate freedom. Neural Collapse sharpens this probl…
At-Grok Is Not Converged:A Measurement-Validity Audit for Grokking Representation Metrics
Truong Xuan Khanh
On modular arithmetic, a network's embedding keeps compressing for tens of thousands of steps after it has already generalized. Reading effective rank at the grokking transition ov…
Cross-Trajectory Chimera Interventions Reveal Dissociable Roles of Weight Magnitude and Direction in Grokking
Truong Xuan Khanh
Which properties of a partially trained network are causally portable to a different, independently trained network? Single-trajectory interventions show necessity within one run,…
What Does the Weight Norm Control in Grokking? Logit-Scale Mediation under Cross-Entropy
Truong Xuan Khanh
Grokking, the delayed jump from memorization to generalization, is usually tied to the weight norm: a smaller norm generalizes sooner. We ask what the norm actually controls. Holdi…
The Weight Norm Sets the Grokking Timescale: A Causal Delay Law
Truong Xuan Khanh, Doan Hoang Viet, Luu Duc Trung +1
Grokking is the delayed onset of generalization in neural networks, arising long after they fit the training data. Whether the weight norm causes this delay is disputed: some studi…
Emergence via Phase Transitions: Mechanism Landscapes and Universal Convergence Across Complex Systems
Truong Xuan Khanh
Across machine learning, biology, and physics, independently evolving systems often converge toward strikingly similar high-level structures despite radically different microscopic…
First-Passage Prediction of Grokking Delay: ACalibrated Law under AdamW with Causal Validation
Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung +1
We give the first quantitative prediction of grokking delay under AdamW. Treating the delay as a first-passage time, we derive a closed-form law T_grok - T_mem = (1 / 2 kappa_LL et…
Spectral Entropy Collapse as a Phase Transition in Delayed Generalisation: An Interventional and Predictive Framework for Grokkin
Truong Xuan Khanh, Truong Quynh Hoa, Luu Duc Trung +1
Grokking - the delayed transition from memorisation to generalisation in neural networks - remains poorly understood. We study this phenomenon through the geometry of learned repre…
Phase Transitions in Driven Informational Systems: A Two-Field Perspective on Learning Theory and Non-Equilibrium Chemistry
Truong Xuan Khanh
Phase-transition phenomena in deep learning (grokking, emergent capabilities, and ontological reorganization under context shift) have been studied through several lenses, includin…
Norm-Hierarchy Transitions in Representation Learning: When and Why Neural Networks Abandon Shortcuts
Truong Xuan Khanh, Truong Quynh Hoa
Neural networks often rely on spurious shortcuts for many epochs before discovering structured representations. However, the mechanism governing when this transition occurs and whe…
Edge Computing in Distributed Acoustic Sensing: An Application in Traffic Monitoring
Khanh Truong, Jo Eidsvik, Robin Andre Rørstadbotnen
Distributed acoustic sensing (DAS) technology leverages fiber optic cables to detect vibrations and acoustic events, which is a promising solution for real-time traffic monitoring.…