4 papers · 1 filter
Towards counterfactual fairness through auxiliary variables
Bowei Tian, Ziyao Wang, Shwai He +5
The challenge of balancing fairness and predictive accuracy in machine learning models, especially when sensitive attributes such as race, gender, or age are considered, has motiva…
SPARC: Scalable Path-Specific Counterfactual Fairness via Causal Conditional Independence
Bowei Tian, Yexiao He, Ziyao Wang +3
Deep learning models exhibit fairness concerns when predictions are inadvertently influenced by sensitive attributes. However, existing attempts to make Path-Specific Counterfactua…
Revisiting Federated Fine-Tuning: A Single Communication Round is Enough for Foundation Models
Ziyao Wang, Bowei Tian, Yexiao He +6
The recent advancement of foundation models (FMs) has increased the demand for fine-tuning these models on large-scale cross-domain datasets. To address this, federated fine-tuning…
Router-Tuning: A Simple and Effective Approach for Enabling Dynamic-Depth in Transformers
Shwai He, Tao Ge, Guoheng Sun +3
Traditional transformer models often allocate a fixed amount of computational resources to every input token, leading to inefficient and unnecessary computation. To address this, t…