24 citations · 35 across the 17 of their papers we have counts for
17 papers
Multi-turn RL with Structural and Performance Aware Rewards for CUDA Kernel Generation
Quazi Ishtiaque Mahmud, Nesreen K. Ahmed, Ali Jannesari
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful technique to enhance the reasoning capacity of LLMs for optimized code generation. However, existing…
ReM-MoA: Reasoning Memory Sustains Mixture-of-Agents Scaling
Heng Ping, Arijit Bhattacharjee, Peiyu Zhang +5
Mixture-of-Agents (MoA) architectures improve inference-time scaling by organizing multiple LLM agents into layered reasoning pipelines. However, existing MoA variants fail to sust…
Agent-ToM: Learning to Monitor Autonomous LLM Agents via Theory-of-Mind Reasoning
Nesreen K. Ahmed, Nima Nafisi
Monitoring autonomous large language model (LLM) agents for covert malicious behavior is challenging due to delayed, context-dependent, and long-horizon attack patterns. Agents may…
D3-Gym: Constructing Real-World Verifiable Environments for Data-Driven Discovery
Hanane Nour Moussa, Yifei Li, Zhuoyang Li +7
Despite recent progress in language models and agents for scientific data-driven discovery, advancing their capabilities is held back by the absence of verifiable environments repr…
Human-Aligned MLLM Judges for Fine-Grained Image Editing Evaluation: A Benchmark, Framework, and Analysis
Runzhou Liu, Hailey Weingord, Sejal Mittal +18
Evaluating image editing models remains challenging due to the coarse granularity and limited interpretability of traditional metrics, which often fail to capture aspects important…
OptiML: An End-to-End Framework for Program Synthesis and CUDA Kernel Optimization
Arijit Bhattacharjee, Heng Ping, Son Vu Le +3
Generating high-performance CUDA kernels remains challenging due to the need to navigate a combinatorial space of low-level transformations under noisy and expensive hardware feedb…
OMPILOT: Harnessing Transformer Models for Auto Parallelization to Shared Memory Computing Paradigms
Arijit Bhattacharjee, Ali TehraniJamsaz, Le Chen +4
Recent advances in large language models (LLMs) have significantly accelerated progress in code translation, enabling more accurate and efficient transformation across programming…
VeriMoA: A Mixture-of-Agents Framework for Spec-to-HDL Generation
Heng Ping, Arijit Bhattacharjee, Peiyu Zhang +8
Automation of Register Transfer Level (RTL) design can help developers meet increasing computational demands. Large Language Models (LLMs) show promise for Hardware Description Lan…
Learning Bug Context for PyTorch-to-JAX Translation with LLMs
Hung Phan, Son Vu, Tuan Dinh +3
Large language models (LLMs) have shown strong performance on code translation between widely used programming languages. However, translation becomes much less reliable for domain…
AutoSDT: Scaling Data-Driven Discovery Tasks Toward Open Co-Scientists
Yifei Li, Hanane Nour Moussa, Ziru Chen +16
Despite long-standing efforts in accelerating scientific discovery with AI, building AI co-scientists remains challenging due to limited high-quality data for training and evaluati…
CodeRosetta: Pushing the Boundaries of Unsupervised Code Translation for Parallel Programming
Ali TehraniJamsaz, Arijit Bhattacharjee, Le Chen +3
Recent advancements in Large Language Models (LLMs) have renewed interest in automatic programming language translation. Encoder-decoder transformer models, in particular, have sho…
OMPar: Automatic Parallelization with AI-Driven Source-to-Source Compilation
Tal Kadosh, Niranjan Hasabnis, Prema Soundararajan +5
Manual parallelization of code remains a significant challenge due to the complexities of modern software systems and the widespread adoption of multi-core architectures. This pape…
The Landscape and Challenges of HPC Research and LLMs
Le Chen, Nesreen K. Ahmed, Akash Dutta +14
Recently, language models (LMs), especially large language models (LLMs), have revolutionized the field of deep learning. Both encoder-decoder models and prompt-based techniques ha…
MPIrigen: MPI Code Generation through Domain-Specific Language Models
Nadav Schneider, Niranjan Hasabnis, Vy A. Vo +9
The imperative need to scale computation across numerous nodes highlights the significance of efficient parallel computing, particularly in the realm of Message Passing Interface (…
OMPGPT: A Generative Pre-trained Transformer Model for OpenMP
Le Chen, Arijit Bhattacharjee, Nesreen Ahmed +4
Large language models (LLMs)such as ChatGPT have significantly advanced the field of Natural Language Processing (NLP). This trend led to the development of code-based large langua…
CompCodeVet: A Compiler-guided Validation and Enhancement Approach for Code Dataset
Le Chen, Arijit Bhattacharjee, Nesreen K. Ahmed +4
Large language models (LLMs) have become increasingly prominent in academia and industry due to their remarkable performance in diverse applications. As these models evolve with in…
AutoParLLM: GNN-guided Context Generation for Zero-Shot Code Parallelization using LLMs
Quazi Ishtiaque Mahmud, Ali TehraniJamsaz, Hung Phan +5
In-Context Learning (ICL) has been shown to be a powerful technique to augment the capabilities of LLMs for a diverse range of tasks. This work proposes \ourtool, a novel way to ge…