5 citations · 14 across the 7 of their papers we have counts for
7 papers
Mind the Delay: Latency-aware Query Routing for Heterogeneous LLM pools
Shivam Patel, Akaash R. Parthasarathy, Ankur Mallick +2
Large language model (LLM) query routers typically assign each query to a suitable model that balances response accuracy and monetary cost. Subsequently, separate system-level load…
ProxRouter: Proximity-Weighted LLM Query Routing for Improved Robustness to Outliers
Shivam Patel, Neharika Jali, Ankur Mallick +1
Large language model (LLM) query routers are critical to modern AI platforms as they seek to improve efficiency by assigning inference queries to accurate, yet low-cost models. Par…
Leveraging Spatial and Temporal Correlations in Sparsified Mean Estimation
Divyansh Jhunjhunwala, Ankur Mallick, Advait Gadhikar +2
We study the problem of estimating at a central server the mean of a set of vectors distributed across several nodes (one vector per node). When the vectors are high-dimensional, t…
Probabilistic Neighbourhood Component Analysis: Sample Efficient Uncertainty Estimation in Deep Learning
Ankur Mallick, Chaitanya Dwivedi, Bhavya Kailkhura +2
While Deep Neural Networks (DNNs) achieve state-of-the-art accuracy in various applications, they often fall short in accurately estimating their predictive uncertainty and, in tur…
Deep Kernels with Probabilistic Embeddings for Small-Data Learning
Ankur Mallick, Chaitanya Dwivedi, Bhavya Kailkhura +2
Gaussian Processes (GPs) are known to provide accurate predictions and uncertainty estimates even with small amounts of labeled data by capturing similarity between data points thr…
Rateless Codes for Near-Perfect Load Balancing in Distributed Matrix-Vector Multiplication
Ankur Mallick, Malhar Chaudhari, Utsav Sheth +2
Large-scale machine learning and data mining applications require computer systems to perform massive matrix-vector and matrix-matrix multiplication operations that need to be para…