10 papers
FedQueue: Queue-Aware Federated Learning for Cross-Facility HPC Training
Yijiang Li, Emon Dey, Zilinghan Li +3
Federated learning (FL) across multiple HPC facilities faces stochastic admission delays from batch schedulers that dominate wall-clock time. Synchronous FL suffers from severe str…
Scalable Heterogeneous Graph Foundation Models for Data-Driven Optimal Power Flow in Smart Grids
Massimiliano Lupo Pasini, Yijiang Li, Kibaek Kim +1
Fast and reliable optimal power flow (OPF) approximation is essential for reliable smart-grid operation, yet many learning-based surrogates either flatten the native heterogeneous…
Attention Sinks and Outliers in Attention Residuals
Haozheng Luo, Haoran Dai, Shaoyang Zhang +10
We propose OASIS, an outlier- and sink-aware technique built on inter-layer null signaling. As AttnResidual architectures introduce an additional depth-wise normalization channel,…
LUMINA: A Grid Foundation Model for Benchmarking AC Optimal Power Flow Surrogate Learning
Hongwei Jin, Keunju Song, Zeeshan Memon +5
AC optimal power flow (ACOPF) is foundational yet computationally expensive in power grid operations, driving learning-based surrogates for large-scale grid analysis. These surroga…
Towards Systematic Generalization for Power Grid Optimization Problems
Zeeshan Memon, Yijiang Li, Hongwei Jin +2
AC Optimal Power Flow (ACOPF) and Security-Constrained Unit Commitment (SCUC) are fundamental optimization problems in power system operations. ACOPF serves as the physical backbon…
LUMINA: Foundation Models for Topology Transferable ACOPF
Yijiang Li, Zeeshan Memon, Hongwei Jin +7
Foundation models in general promise to accelerate scientific computation by learning reusable representations across problem instances, yet constrained scientific systems, where p…