36 citations · 37 across the 10 of their papers we have counts for
4 papers · 1 filter
What if I ask in \textit{alia lingua}? Measuring Functional Similarity Across Languages
Debangan Mishra, Arihant Rastogi, Agyeya Negi +2
How similar are model outputs across languages? In this work, we study this question using a recently proposed model similarity metric applied to 20 languages and 47 subjects…
Answer Matching Outperforms Multiple Choice for Language Model Evaluation
Nikhil Chandak, Shashwat Goel, Ameya Prabhu +2
Multiple choice benchmarks have long been the workhorse of language model evaluation because grading multiple choice is objective and easy to automate. However, we show multiple ch…
Enhancing AI Safety Through the Fusion of Low Rank Adapters
Satya Swaroop Gudipudi, Sreeram Vipparla, Harpreet Singh +2
Instruction fine-tuning of large language models (LLMs) is a powerful method for improving task-specific performance, but it can inadvertently lead to a phenomenon where models gen…
From Pivots to Graphs: Augmented CycleDensity as a Generalization to One Time InverseConsultation
Shashwat Goel, Kunwar Shaanjeet Singh Grover
This paper describes an approach used to generate new translations using raw bilingual dictionaries as part of the 4th Task Inference Across Dictionaries (TIAD 2021) shared task. W…