4 papers
RAPID: Reliability-Aware Pair Importance Distillation
Ali Mahdavi, Azadeh Zamanifar, Amirfarhad Farhadi +1
Inter example relational distillation transfers a teacher's representation geometry by matching relations among examples within a mini batch. Computing all pairs has quadratic comp…
Spectral-LSH: Sub-Quadratic Prompt Compression via Krylov-Projected Locality-Sensitive Hashing
Ali Mahdavi, Azaseh Zamanifar, Amirfarhad Farhadi +1
Long-prompt inference remains expensive because prefill attention scales quadratically with sequence length. We propose Spectral-LSH, a training-free prompt compression method that…
Causal Unlearning in Collaborative Optimization: Exact and Approximate Influence Reversal under Adversarial Contributions
Ali Mahdavi, Azadeh Zamanifar, Amirfarhad Farhadi +1
Federated learning systems must support data deletion requests to comply with privacy regulations, yet retraining from scratch after each deletion is computationally prohibitive. W…
TinyGuard:A lightweight Byzantine Defense for Resource-Constrained Federated Learning via Statistical Update Fingerprints
Ali Mahdavi, Santa Aghapour, Azadeh Zamanifar +1
Existing Byzantine robust aggregation mechanisms typically rely on fulldimensional gradi ent comparisons or pairwise distance computations, resulting in computational overhead that…