activity
20242026
most citedDemystifying AI Platform Design for Distributed Inference of Next-Generation LLM models

1 citations · 1 across the 11 of their papers we have counts for

collaborators

12 papers

cs.AI2026

ORACLE: Agentic AI Orchestrator Routing Via Adaptive Verifier Calibration Feedback

Ritik Raj, Souvik Kundu, Sarbartha Banerjee +3

Modern enterprise agent deployments consist of a heterogeneous pool of large language models (LLMs) having diverse capabilities and cost. Existing model routing strategies optimize…

cs.AR2026

SCALE-Sim EVA: Design Principles for an Extensible, Visualizable, and Adaptable Accelerator Simulation Framework

Jingtian Dang, Ritik Raj, Tushar Krishna

Modern AI accelerators increasingly combine heterogeneous compute units, hierarchical memories, local buffers, and specialized data movement paths. This diversity makes fixed accel…

cs.AR2026

SCALE-Sim TPU: Validating and Extending SCALE-Sim for TPUs

Jingtian Dang, Ritik Raj, Changhai Man +2

Cycle-accurate simulators are widely used to study systolic accelerators, yet their accuracy and usability are often limited by weak validation against real hardware and poor integ…

cs.AI2025

Towards Understanding, Analyzing, and Optimizing Agentic AI Execution: A CPU-Centric Perspective

Ritik Raj, Souvik Kundu, Ishita Vohra +2

Agentic AI serving converts monolithic LLM-based inference to autonomous problem-solvers that can plan, call tools, perform reasoning, and adapt on the fly. Due to diverse task exe…

cs.PF2025

SCALE-Sim v3: A modular cycle-accurate systolic accelerator simulator for end-to-end system analysis

Ritik Raj, Sarbartha Banerjee, Nikhil Chandra +4

The rapid advancements in AI, scientific computing, and high-performance computing (HPC) have driven the need for versatile and efficient hardware accelerators. Existing tools like…

cs.AR2025

MCMComm: Hardware-Software Co-Optimization for End-to-End Communication in Multi-Chip-Modules

Ritik Raj, Shengjie Lin, William Won +1

Increasing AI computing demands and slowing transistor scaling have led to the advent of Multi-Chip-Module (MCMs) based accelerators. MCMs enable cost-effective scalability, higher…

cs.AR2025

OneDSE: Metric-Conditioned Inverse Modeling and Active Search for Sample-Efficient DSE

Ritik Raj, Akshat Ramachandran, Danny Samuel +3

We identify two key challenges in prior CPU design space exploration (DSE) approaches: (a) short-horizon prediction is forward-only: modeling PPA metrics from design parameters whi…

cs.AR2025

NSFlow: An End-to-End FPGA Framework with Scalable Dataflow Architecture for Neuro-Symbolic AI

Hanchen Yang, Zishen Wan, Ritik Raj +5

Neuro-Symbolic AI (NSAI) is an emerging paradigm that integrates neural networks with symbolic reasoning to enhance the transparency, reasoning capabilities, and data efficiency of…

cs.AR2025

CogSys: Efficient and Scalable Neurosymbolic Cognition System via Algorithm-Hardware Co-Design

Zishen Wan, Hanchen Yang, Ritik Raj +4

Neurosymbolic AI is an emerging compositional paradigm that fuses neural learning with symbolic reasoning to enhance the transparency, interpretability, and trustworthiness of AI.…

cs.AR2025

Axon: A novel systolic array architecture for improved run time and energy efficient GeMM and Conv operation with on-chip im2col

Md Mizanur Rahaman Nayan, Ritik Raj, Gouse Basha Shaik +2

General matrix multiplication (GeMM) is a core operation in virtually all AI applications. Systolic array (SA) based architectures have shown great promise as GeMM hardware acceler…

cs.AR2024

Towards Efficient Neuro-Symbolic AI: From Workload Characterization to Hardware Architecture

Zishen Wan, Che-Kai Liu, Hanchen Yang +13

The remarkable advancements in artificial intelligence (AI), primarily driven by deep neural networks, are facing challenges surrounding unsustainable computational trajectories, l…

cs.AR2024★ 1 cited

Demystifying AI Platform Design for Distributed Inference of Next-Generation LLM models

Abhimanyu Bambhaniya, Ritik Raj, Geonhwa Jeong +6

Large language models (LLMs) have shown remarkable performance across a wide range of applications, often outperforming human experts. However, deploying these gigantic models effi…