46 citations · 142 across the 4 of their papers we have counts for
5 papers
More GPUs or a Smaller Cache? Tensor Parallelism versus KV Compression for Memory-Bound LLM Serving
Srikanta Datta Tumkur, Mehar Simhadri, Anshu Bansal +5
When an LLM serving deployment runs out of KVcache room, there are two well-established ways out. Tensor parallelism shards the weights and the KV cache across two, four, or eight…
Bayesian Neural Ordinary Differential Equations
Raj Dandekar, Karen Chung, Vaibhav Dixit +4
Recently, Neural Ordinary Differential Equations has emerged as a powerful framework for modeling physical simulations without explicitly defining the ODEs governing the system, bu…
A machine learning aided global diagnostic and comparative tool to assess effect of quarantine control in Covid-19 spread
Raj Dandekar, Chris Rackauckas, George Barbastathis
We have developed a globally applicable diagnostic Covid-19 model by augmenting the classical SIR epidemiological model with a neural network module. Our model does not rely upon p…
Neural Network aided quarantine control model estimation of global Covid-19 spread
Raj Dandekar, George Barbastathis
Since the first recording of what we now call Covid-19 infection in Wuhan, Hubei province, China on Dec 31, 2019, the disease has spread worldwide and met with a wide variety of so…
Neural Network aided quarantine control model estimation of COVID spread in Wuhan, China
Raj Dandekar, George Barbastathis
In a move described as unprecedented in public health history, starting 24 January 2020, China imposed quarantine and isolation restrictions in Wuhan, a city of more than 10 millio…