2 papers
cs.DC2026
Towards Distributed Inference of LLMs on a P2P Network
Shabari S Nair, Krishanu Saini
Prefix caching can reduce LLM inference latency by reusing KV caches across requests with shared prompts, but cluster-scale reuse is challenging because caches are partitioned acro…
cs.CV2023
Video Anomaly Detection using GAN
Anikeit Sethi, Krishanu Saini, Sai Mounika Mididoddi
Accounting for the increased concern for public safety, automatic abnormal event detection and recognition in a surveillance scene is crucial. It is a current open study subject be…