4 papers
Succeeding at Scale: Enterprise Retrieval Benchmark Construction and Index-Preserving Query Adaptation for Multi-Tenant Search
Prateek Jain, Shabari S Nair, Ritesh Goru +4
Large-scale multi-tenant retrieval systems generate extensive query logs but lack curated relevance labels for effective domain adaptation, resulting in substantial underutilized "…
Towards Distributed Inference of LLMs on a P2P Network
Shabari S Nair, Krishanu Saini
Prefix caching can reduce LLM inference latency by reusing KV caches across requests with shared prompts, but cluster-scale reuse is challenging because caches are partitioned acro…
Adopting Whisper for Confidence Estimation
Vaibhav Aggarwal, Shabari S Nair, Yash Verma +1
Recent research on word-level confidence estimation for speech recognition systems has primarily focused on lightweight models known as Confidence Estimation Modules (CEMs), which…
Improving Rare-Word Recognition of Whisper in Zero-Shot Settings
Yash Jogi, Vaibhav Aggarwal, Shabari S Nair +2
Whisper, despite being trained on 680K hours of web-scaled audio data, faces difficulty in recognising rare words like domain-specific terms, with a solution being contextual biasi…