1 citations · 1 across the 12 of their papers we have counts for
12 papers
FedQueue: Queue-Aware Federated Learning for Cross-Facility HPC Training
Yijiang Li, Emon Dey, Zilinghan Li +3
Federated learning (FL) across multiple HPC facilities faces stochastic admission delays from batch schedulers that dominate wall-clock time. Synchronous FL suffers from severe str…
Scalable Heterogeneous Graph Foundation Models for Data-Driven Optimal Power Flow in Smart Grids
Massimiliano Lupo Pasini, Yijiang Li, Kibaek Kim +1
Fast and reliable optimal power flow (OPF) approximation is important for power system operation, yet heterogeneous OPF graph models are often evaluated either with architecture-sp…
Attention Sinks and Outliers in Attention Residuals
Haozheng Luo, Haoran Dai, Shaoyang Zhang +10
We propose OASIS, an outlier- and sink-aware method that stabilizes dual-normalized attention-residual architectures through explicit null routing and token-to-depth null coupling.…
LUMINA: A Grid Foundation Model for Benchmarking AC Optimal Power Flow Surrogate Learning
Hongwei Jin, Keunju Song, Zeeshan Memon +5
AC optimal power flow (ACOPF) is foundational yet computationally expensive in power grid operations, driving learning-based surrogates for large-scale grid analysis. These surroga…
Towards Systematic Generalization for Power Grid Optimization Problems
Zeeshan Memon, Yijiang Li, Hongwei Jin +2
AC Optimal Power Flow (ACOPF) and Security-Constrained Unit Commitment (SCUC) are fundamental optimization problems in power system operations. ACOPF serves as the physical backbon…
LUMINA: Foundation Models for Topology Transferable ACOPF
Yijiang Li, Zeeshan Memon, Hongwei Jin +7
Foundation models in general promise to accelerate scientific computation by learning reusable representations across problem instances, yet constrained scientific systems, where p…
Scalable Cross-Facility Federated Learning for Scientific Foundation Models on Multiple Supercomputers
Yijiang Li, Zilinghan Li, Kyle Chard +4
Artificial Intelligence for scientific applications increasingly requires training large models on data that cannot be centralized due to privacy constraints, data sovereignty, or…
Experiences Building Enterprise-Level Privacy-Preserving Federated Learning to Power AI for Science
Zilinghan Li, Aditya Sinha, Yijiang Li +3
Federated learning (FL) is a promising approach to enabling collaborative model training without centralized data sharing, a crucial requirement in scientific domains where data pr…
From RNNs to Foundation Models: An Empirical Study on Commercial Building Energy Consumption
Shourya Bose, Yijiang Li, Amy Van Sant +2
Accurate short-term energy consumption forecasting for commercial buildings is crucial for smart grid operations. While smart meters and deep learning models enable forecasting usi…
FedSpaLLM: Federated Pruning of Large Language Models
Guangji Bai, Yijiang Li, Zilinghan Li +2
Large Language Models (LLMs) achieve state-of-the-art performance but are challenging to deploy due to their high computational and storage demands. Pruning can reduce model size,…
Modeling and solving cascading failures across interdependent infrastructure systems
Yijiang Li, Kibaek Kim, Sven Leyffer +3
Physical infrastructure systems supply crucial resources to residential, commercial, and industrial activities. These infrastructure systems generally consist of multiple types of…
SparseLLM: Towards Global Pruning for Pre-trained Language Models
Guangji Bai, Yijiang Li, Chen Ling +2
The transformative impact of large language models (LLMs) like LLaMA and GPT on natural language processing is countered by their prohibitive computational demands. Pruning has eme…