8 citations · 38 across the 28 of their papers we have counts for
30 papers
Operationally Feasible Synthetic Power-Grid Scenarios via Learning the AC-Operable Joint Distribution
Chenhan Xiao, Xinyu He, Haoran Li +2
Synthetic power-grid scenarios are essential for planning, resilience assessment, contingency analysis, and data-driven power-system applications. Recent synthetic grid generation…
AvAtar: Learning to Align via Active Optimal Transport
Qi Yu, Ruizhong Qiu, Zhichen Zeng +3
Alignment plays a fundamental role in many machine learning problems, such as multi-network analysis, multimodal learning, and point cloud registration. Recent works increasingly l…
ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning
Ruizhong Qiu, Hanqing Zeng, Yinglong Xia +15
Low-rank adapters (LoRAs) are a parameter-efficient finetuning technique that injects trainable low-rank matrices into pretrained models to adapt them to new tasks. Mixture-of-LoRA…
Harnessing Consistency for Robust Test-Time LLM Ensemble
Zhichen Zeng, Qi Yu, Xiao Lin +6
Different large language models (LLMs) exhibit diverse strengths and weaknesses, and LLM ensemble serves as a promising approach to integrate their complementary capabilities. Desp…
PowerGrow: Feasible Co-Growth of Structures and Dynamics for Power Grid Synthesis
Xinyu He, Chenhan Xiao, Haoran Li +5
Modern power systems are becoming increasingly dynamic, with changing topologies and time-varying loads driven by renewable energy variability, electric vehicle adoption, and activ…
Neural Predictive Control to Coordinate Discrete- and Continuous-Time Models for Time-Series Analysis with Control-Theoretical Improvements
Haoran Li, Muhao Guo, Yang Weng +1
Deep sequence models have achieved notable success in time-series analysis, such as interpolation and forecasting. Recent advances move beyond discrete-time architectures like Recu…
Latte: Collaborative Test-Time Adaptation of Vision-Language Models in Federated Learning
Wenxuan Bao, Ruxi Deng, Ruizhong Qiu +3
Test-time adaptation with pre-trained vision-language models has gained increasing attention for addressing distribution shifts during testing. Among these approaches, memory-based…
Flow Matching Meets Biology and Life Science: A Survey
Zihao Li, Zhichen Zeng, Xiao Lin +9
Over the past decade, advances in generative modeling, such as generative adversarial networks, masked autoencoders, and diffusion models, have significantly transformed biological…
Breaking Silos: Adaptive Model Fusion Unlocks Better Time Series Forecasting
Zhining Liu, Ze Yang, Xiao Lin +6
Time-series forecasting plays a critical role in many real-world applications. Although increasingly powerful models have been developed and achieved superior results on benchmark…
CLIMB: Class-imbalanced Learning Benchmark on Tabular Data
Zhining Liu, Zihao Li, Ze Yang +6
Class-imbalanced learning (CIL) on tabular data is important in many real-world applications where the minority class holds the critical but rare outcomes. In this paper, we presen…
ClimateBench-M: A Multi-Modal Climate Data Benchmark with a Simple Generative Method
Dongqi Fu, Yada Zhu, Zhining Liu +10
Climate science studies the structure and dynamics of Earth's climate system and seeks to understand how climate changes over time, where the data is usually stored in the format o…
Tensor Convolutional Network for Higher-Order Interaction Prediction in Sparse Tensors
Jun-Gi Jang, Jingrui He, Andrew Margenot +1
Many real-world data, such as recommendation data and temporal graphs, can be represented as incomplete sparse tensors where most entries are unobserved. For such sparse tensors, i…
ResMoE: Space-efficient Compression of Mixture of Experts LLMs via Residual Restoration
Mengting Ai, Tianxin Wei, Yifan Chen +7
Mixture-of-Experts (MoE) Transformer, the backbone architecture of multiple phenomenal language models, leverages sparsity by activating only a fraction of model parameters for eac…
Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative
Zihao Li, Xiao Lin, Zhining Liu +8
While many advances in time series models focus exclusively on numerical data, research on multimodal time series, particularly those involving contextual textual information, rema…
SelfElicit: Your Language Model Secretly Knows Where is the Relevant Evidence
Zhining Liu, Rana Ali Amjad, Ravinarayana Adkathimar +2
Providing Language Models (LMs) with relevant evidence in the context (either via retrieval or user-provided) can significantly improve their ability to provide better-grounded res…
PyG-SSL: A Graph Self-Supervised Learning Toolkit
Lecheng Zheng, Baoyu Jing, Zihao Li +9
Graph Self-Supervised Learning (SSL) has emerged as a pivotal area of research in recent years. By engaging in pretext tasks to learn the intricate topological structures and prope…
PageRank Bandits for Link Prediction
Yikun Ban, Jiaru Zou, Zihao Li +5
Link prediction is a critical problem in graph learning with broad applications such as recommender systems and knowledge graph completion. Numerous research efforts have been dire…
Transforming the Hybrid Cloud for Emerging AI Workloads
Deming Chen, Alaa Youssef, Ruchi Pendse +42
This white paper, developed through close collaboration between IBM Research and UIUC researchers within the IIDAI Institute, envisions transforming hybrid cloud systems to meet th…
Ask, and it shall be given: On the Turing completeness of prompting
Ruizhong Qiu, Zhe Xu, Wenxuan Bao +1
Since the success of GPT, large language models (LLMs) have been revolutionizing machine learning and have initiated the so-called LLM prompting paradigm. In the era of LLMs, peopl…
BACKTIME: Backdoor Attacks on Multivariate Time Series Forecasting
Xiao Lin, Zhining Liu, Dongqi Fu +2
Multivariate Time Series (MTS) forecasting is a fundamental task with numerous real-world applications, such as transportation, climate, and epidemiology. While a myriad of powerfu…
What Do LLMs Need to Understand Graphs: A Survey of Parametric Representation of Graphs
Dongqi Fu, Liri Fang, Zihao Li +3
Graphs, as a relational data structure, have been widely used for various application scenarios, like molecule design and recommender systems. Recently, large language models (LLMs…
Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation
Wenxuan Bao, Zhichen Zeng, Zhining Liu +2
Powerful as they are, graph neural networks (GNNs) are known to be vulnerable to distribution shifts. Recently, test-time adaptation (TTA) has attracted attention due to its abilit…
WAPITI: A Watermark for Finetuned Open-Source LLMs
Lingjie Chen, Ruizhong Qiu, Siyu Yuan +6
Watermarking of large language models (LLMs) generation embeds an imperceptible statistical pattern within texts, making it algorithmically detectable. Watermarking is a promising…
How to Make LMs Strong Node Classifiers?
Zhe Xu, Kaveh Hassani, Si Zhang +7
Language Models (LMs) are increasingly challenging the dominance of domain-specific models, such as Graph Neural Networks (GNNs) and Graph Transformers (GTs), in graph learning tas…