3 papers
cs.LG2025
MAESTRO : Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series
Payal Mohapatra, Yueyuan Sui, Akash Pandey +2
From clinical healthcare to daily living, continuous sensor monitoring across multiple modalities has shown great promise for real-world intelligent decision-making but also faces…
cs.LG2025
MambaLite-Micro: Memory-Optimized Mamba Inference on MCUs
Hongjun Xu, Junxi Xia, Weisi Yang +2
Deploying Mamba models on microcontrollers (MCUs) remains challenging due to limited memory, the lack of native operator support, and the absence of embedded-friendly toolchains. W…
cs.LG2024
ElastiFormer: Learned Redundancy Reduction in Transformer via Self-Distillation
Junzhang Liu, Tingkai Liu, Yueyuan Sui +1
We introduce ElastiFormer, a post-training technique that adapts pretrained Transformer models into an elastic counterpart with variable inference time compute. ElastiFormer introd…