2 citations · 3 across the 5 of their papers we have counts for
6 papers
An Analytical Framework for a Multi-Particle Oja Flow
Sixu Li
We develop an analytical framework for studying a family of interacting particle systems that we refer to as the multi-particle Oja flow. The common interaction structure underlyin…
On the Diverse Dynamical Behaviors Arising in Deep Linear Transformers
Sixu Li, Thomas Jacob Maranzatto, Jan Peszek +5
We study the inference-time behavior of deep linear encoder-only transformers through the lens of interacting particle systems. In this perspective, tokens are modeled as particles…
Optimal drift optimizer for non-convex optimization
Qin Li, Sixu Li, Eitan Tadmor +1
We study a finite-horizon stochastic control criterion for non-convex optimization in which Brownian exploration is balanced against a quadratic control cost. Rather than emphasizi…
Learning Higher-Order Interactions from Incomplete Spatiotemporal Data with Mixtures of Hypergraph Laplacians
Keshu Wu, Sixu Li, Zihao Li +3
Traffic sensor data exhibit strong temporal and cross-sensor dependencies, yet long gaps erase both a sensor's local history and the joint observations needed to learn its relation…
Defending Against Diverse Attacks in Federated Learning Through Consensus-Based Bi-Level Optimization
Nicolás García Trillos, Aditya Kumar Akash, Sixu Li +2
Adversarial attacks pose significant challenges in many machine learning applications, particularly in the setting of distributed training and federated learning, where malicious a…
CBO: Consensus-Based Bi-Level Optimization
Nicolás García Trillos, Sixu Li, Konstantin Riedl +1
Bi-level optimization problems, where one wishes to find the global minimizer of an upper-level objective function over the globally optimal solution set of a lower-level objective…