4 papers · 1 filter
Test-Time Compute Scaling for ASR with Depth-Conditioned Looped Transformers
Yacouba Kaloga, Shashi Kumar, Shakeel A. Sheikh +3
End-to-end ASR systems typically use fixed-depth acoustic encoders at inference, making it difficult to trade additional test-time computation for improved recognition without trai…
Nonparametric Variational Differential Privacy via Embedding Parameter Clipping
Dina El Zein, Shashi Kumar, James Henderson
The nonparametric variational information bottleneck (NVIB) provides the foundation for nonparametric variational differential privacy (NVDP), a framework for building privacy-pres…
A Differentiable Alignment Framework for Sequence-to-Sequence Modeling via Optimal Transport
Yacouba Kaloga, Shashi Kumar, Petr Motlicek +1
Accurate sequence-to-sequence (seq2seq) alignment is critical for applications like medical speech analysis and language learning tools relying on automatic speech recognition (ASR…
Latent Space Factorization in LoRA
Shashi Kumar, Yacouba Kaloga, John Mitros +2
Low-rank adaptation (LoRA) is a widely used method for parameter-efficient finetuning. However, existing LoRA variants lack mechanisms to explicitly disambiguate task-relevant info…