4 papers
Using LLMs to Mimic the Conversational Dynamics of Reddit Communities
Vedaant Jain, Yoshee Jain, Ishq Gupta +3
Online communities face a constant battle against toxicity and misinformation. While human moderators struggle to keep pace with the volume of content, LLMs offer a promising solut…
Revealing Interpretable Failure Modes of VLMs
Isha Chaudhary, Vedaant V Jain, Kavya Sachdeva +2
Vision-Language Models (VLMs) are increasingly used in safety-critical applications because of their broad reasoning capabilities and ability to generalize with minimal task-specif…
Lumos: Let there be Language Model System Certification
Isha Chaudhary, Vedaant Jain, Prineet Parhar +4
We introduce the first principled framework, Lumos, for specifying and formally certifying Language Model System (LMS) behaviors. Lumos is an imperative probabilistic programming D…
Certifying Knowledge Comprehension in LLMs
Isha Chaudhary, Vedaant V. Jain, Gagandeep Singh
Large Language Models (LLMs) are increasingly deployed in safety-critical systems where they provide answers based on in-context information derived from knowledge bases. As LLMs a…