4 papers
Aligning Language Models Towards Counterfactual Invariance
Basar Demir, Emily Shen, Ksheeraj Sai Vepuri +5
Small variations in prompt characteristics can meaningfully alter the semantics, tone, and contextual assumptions of large language model outputs. Such characteristics can involve…
MaD-RL: Matching Distributions for Calibrating LLMs with Reinforcement Learning
Sourabh Kulkarni, Ksheeraj Sai Vepuri, Basar Demir +8
Reinforcement learning (RL) is widely used in language-model post-training to maximize rewards assigned to individual model outputs, such as scores from binary verifiers or reward…
MLLM-as-a-Judge for Image Safety without Human Labeling
Zhenting Wang, Shuming Hu, Shiyu Zhao +12
Image content safety has become a significant challenge with the rise of visual media on online platforms. Meanwhile, in the age of AI-generated content (AIGC), many image generati…
Class-RAG: Real-Time Content Moderation with Retrieval Augmented Generation
Jianfa Chen, Emily Shen, Trupti Bavalatti +10
Robust content moderation classifiers are essential for the safety of Generative AI systems. In this task, differences between safe and unsafe inputs are often extremely subtle, ma…