5 papers · 1 filter
Beyond Single Bugs: Benchmarking Large Language Models for Multi-Vulnerability Detection
Chinmay Pushkar, Sanchit Kabra, Dhruv Kumar +1
Large Language Models (LLMs) have demonstrated significant potential in automated software security, particularly in vulnerability detection. However, existing benchmarks primarily…
RUST-BENCH: Benchmarking LLM Reasoning on Unstructured Text within Structured Tables
Nikhil Abhyankar, Purvi Chaurasia, Sanchit Kabra +3
Existing tabular reasoning benchmarks mostly test models on small, uniform tables, underrepresenting the complexity of real-world data and giving an incomplete view of Large Langua…
SURFACEBENCH: A Geometry-Aware Benchmark for Symbolic Surface Discovery
Sanchit Kabra, Shobhnik Kriplani, Parshin Shojaee +1
Equation discovery from data is a central challenge in machine learning for science, which requires the recovery of concise symbolic expressions that govern complex physical and ge…
LLEMA: Evolutionary Search with LLMs for Multi-Objective Materials Discovery
Nikhil Abhyankar, Sanchit Kabra, Saaketh Desai +1
Materials discovery requires navigating vast chemical and structural spaces while satisfying multiple, often conflicting, objectives. We present LLM-guided Evolution for MAterials…
Reasoning Towards Fairness: Mitigating Bias in Language Models through Reasoning-Guided Fine-Tuning
Sanchit Kabra, Akshita Jha, Chandan K. Reddy
Recent advances in large-scale generative language models have shown that reasoning capabilities can significantly improve model performance across a variety of tasks. However, the…