4 citations · 5 across the 7 of their papers we have counts for
7 papers
AILuminate: Introducing v1.0 of the AI Risk and Reliability Benchmark from MLCommons
Shaona Ghosh, Heather Frase, Adina Williams +99
The rapid advancement and deployment of AI systems have created an urgent need for standard safety-evaluation frameworks. This paper introduces AILuminate v1.0, the first comprehen…
Analysis of Indic Language Capabilities in LLMs
Aatman Vaidya, Tarunima Prabhakar, Denny George +1
This report evaluates the performance of text-in text-out Large Language Models (LLMs) to understand and generate Indic languages. This evaluation is used to identify and prioritiz…
Overview of the 2023 ICON Shared Task on Gendered Abuse Detection in Indic Languages
Aatman Vaidya, Arnav Arora, Aditya Joshi +1
This paper reports the findings of the ICON 2023 on Gendered Abuse Detection in Indic Languages. The shared task deals with the detection of gendered abuse in online text. The shar…
Misinformation as a harm: structured approaches for fact-checking prioritization
Connie Moon Sehat, Ryan Li, Peipei Nie +2
In this work, we examine how fact-checkers prioritize which claims to fact-check and what tools may assist them in their efforts. Through a series of interviews with 23 professiona…
The Uli Dataset: An Exercise in Experience Led Annotation of oGBV
Arnav Arora, Maha Jinadoss, Cheshta Arora +22
Online gender based violence has grown concomitantly with adoption of the internet and social media. Its effects are worse in the Global majority where many users use social media…
Check Mate: Prioritizing User Generated Multi-Media Content for Fact-Checking
Tarunima Prabhakar, Anushree Gupta, Kruttika Nadig +1
Volume of content and misinformation on social media is rapidly increasing. There is a need for systems that can support fact checkers by prioritizing content that needs to be fact…
Plagiarism Detection in Polyphonic Music using Monaural Signal Separation
Soham De, Indradyumna Roy, Tarunima Prabhakar +4
Given the large number of new musical tracks released each year, automated approaches to plagiarism detection are essential to help us track potential violations of copyright. Most…