4 papers
XLGoBench: Detecting cross-lingual skill gaps with algorithmic tasks
Purvam Jain, Preethi Jyothi, Vihari Piratla +1
We introduce a set of synthetic algorithmic tasks to detect cross-lingual gaps in the abilities of large language models. Our benchmark is commensurate across languages, since it r…
Rethinking Cross-lingual Gaps from a Statistical Viewpoint
Vihari Piratla, Purvam Jain, Darshan Singh +3
Any piece of knowledge is usually expressed in one or a handful of natural languages on the web or in any large corpus. Large Language Models (LLMs) act as a bridge by acquiring kn…
FlatTrack: Eye-tracking with ultra-thin lensless cameras
Purvam Jain, Althaf M. Nazar, Salman S. Khan +2
Existing eye trackers use cameras based on thick compound optical elements, necessitating the cameras to be placed at focusing distance from the eyes. This results in the overall b…
RE-GAINS & EnChAnT: Intelligent Tool Manipulation Systems For Enhanced Query Responses
Sahil Girhepuje, Siva Sankar Sajeev, Purvam Jain +7
Large Language Models (LLMs) currently struggle with tool invocation and chaining, as they often hallucinate or miss essential steps in a sequence. We propose RE-GAINS and EnChAnT,…