7 citations · 18 across the 18 of their papers we have counts for
20 papers
Automated Prefetching for Object Spatial Programming Using Temporal Trace Graphs
Baichuan Li, Jayanaka Dantanarayana, Savini Kashmira +2
Dependent database accesses can serialize application--database round trips on a request's critical path. Planning across traversal steps requires knowing both which relationships…
SIGIL: Skill Compilation for Reliable and Efficient Agent Execution
Jayanaka Dantanarayana, Savini Kashmira, Lingjia Tang +1
Agent skills describe reusable procedures, but runtime models must still interpret their instructions and coordinate execution. We introduce Skill Compilation, which translates the…
Kernel Forge: An Agent Harness for LLM-based Generation and Optimization of CUDA Kernels
Joshua Brodsky, Dhravid Kumar, Savini Kashmira +4
Machine learning models are increasingly embedded in everyday software, and most of their runtime is spent in a small set of compute kernels such as matrix multiplication, convolut…
Prompt Less, Smile More: MTP with Semantic Engineering in Lieu of Prompt Engineering
Jayanaka L. Dantanarayana, Savini Kashmira, Thakee Nathees +4
AI-Integrated programming is emerging as a foundational paradigm for building intelligent systems with large language models (LLMs). Recent approaches such as Meaning Typed Program…
GraphMend: Code Transformations for Fixing Graph Breaks in PyTorch 2
Savini Kashmira, Jayanaka Dantanarayana, Thamirawaran Sathiyalogeswaran +3
This paper presents GraphMend, a compiler technique that automatically fixes FX graph breaks in PyTorch 2 programs. Although PyTorch 2 introduced TorchDynamo and TorchInductor to e…
GraphRunner: A Multi-Stage Framework for Efficient and Accurate Graph-Based Retrieval
Savini Kashmira, Jayanaka L. Dantanarayana, Krisztián Flautner +2
Conventional Retrieval Augmented Generation (RAG) approaches are common in text-based applications. However, they struggle with structured, interconnected datasets like knowledge g…
SLMEval: Entropy-Based Calibration for Human-Aligned Evaluation of Large Language Models
Roland Daynauth, Christopher Clarke, Krisztian Flautner +2
The LLM-as-a-Judge paradigm offers a scalable, reference-free approach for evaluating language models. Although several calibration techniques have been proposed to better align th…
TOBUGraph: Knowledge Graph-Based Retrieval for Enhanced LLM Performance Beyond RAG
Savini Kashmira, Jayanaka L. Dantanarayana, Joshua Brodsky +5
Retrieval-Augmented Generation (RAG) is one of the leading and most widely used techniques for enhancing LLM retrieval capabilities, but it still faces significant limitations in c…
Ranking Unraveled: Recipes for LLM Rankings in Head-to-Head AI Combat
Roland Daynauth, Christopher Clarke, Krisztian Flautner +2
Deciding which large language model (LLM) to use is a complex challenge. Pairwise ranking has emerged as a new method for evaluating human preferences for LLMs. This approach entai…
PEFT-U: Parameter-Efficient Fine-Tuning for User Personalization
Christopher Clarke, Yuzhao Heng, Lingjia Tang +1
The recent emergence of Large Language Models (LLMs) has heralded a new era of human-AI interaction. These sophisticated models, exemplified by Chat-GPT and its successors, have ex…
MTP: A Meaning-Typed Language Abstraction for AI-Integrated Programming
Jayanaka L. Dantanarayana, Yiping Kang, Kugesan Sivasothynathan +6
Software development is shifting from traditional programming to AI-integrated applications that leverage generative AI and large language models (LLMs) during runtime. However, in…
One Agent Too Many: User Perspectives on Approaches to Multi-agent Conversational AI
Christopher Clarke, Karthik Krishnamurthy, Walter Talamonti +3
Conversational agents have been gaining increasing popularity in recent years. Influenced by the widespread adoption of task-oriented agents such as Apple Siri and Amazon Alexa, th…
Scaling Down to Scale Up: A Cost-Benefit Analysis of Replacing OpenAI's LLM with Open Source SLMs in Production
Chandra Irugalbandara, Ashish Mahendra, Roland Daynauth +6
Many companies use large language models (LLMs) offered as a service, like OpenAI's GPT-4, to create AI-enabled product experiences. Along with the benefits of ease-of-use and shor…
Label Agnostic Pre-training for Zero-shot Text Classification
Christopher Clarke, Yuzhao Heng, Yiping Kang +3
Conventional approaches to text classification typically assume the existence of a fixed set of predefined labels to which a given text can be classified. However, in real-world ap…
The Jaseci Programming Paradigm and Runtime Stack: Building Scale-out Production Applications Easy and Fast
Jason Mars, Yiping Kang, Roland Daynauth +4
Today's production scale-out applications include many sub-application components, such as storage backends, logging infrastructure and AI models. These components have drastically…
One Agent To Rule Them All: Towards Multi-agent Conversational AI
Christopher Clarke, Joseph Joshua Peper, Karthik Krishnamurthy +6
The increasing volume of commercially available conversational agents (CAs) on the market has resulted in users being burdened with learning and adopting multiple agents to accompl…
Towards Personalized Intelligence at Scale
Yiping Kang, Ashish Mahendra, Christopher Clarke +2
Personalized Intelligence (PI) is the problem of providing customized AI experiences tailored to each individual user. In many applications, PI is preferred or even required. Exist…
An Evaluation Dataset for Intent Classification and Out-of-Scope Prediction
Stefan Larson, Anish Mahendran, Joseph J. Peper +8
Task-oriented dialog systems need to know when a query falls outside their range of supported intents, but current text classification corpora only define label sets that cover eve…
Outlier Detection for Improved Data Quality and Diversity in Dialog Systems
Stefan Larson, Anish Mahendran, Andrew Lee +6
In a corpus of data, outliers are either errors: mistakes in the data that are counterproductive, or are unique: informative samples that improve model robustness. Identifying outl…
Rethinking Numerical Representations for Deep Neural Networks
Parker Hill, Babak Zamirai, Shengshuo Lu +9
With ever-increasing computational demand for deep learning, it is critical to investigate the implications of the numeric representation and precision of DNN model weights and act…