4 papers
Concept Attractors in LLMs and their Applications
Sotirios Panagiotis Chytas, Vikas Singh
Large language models (LLMs) often map semantically related prompts to similar internal representations at specific layers, even when their surface forms differ widely. We show tha…
FoGE: Fock Space inspired encoding for graph prompting
Sotirios Panagiotis Chytas, Rudrasis Chakraborty, Vikas Singh
Recent results show that modern Large Language Models (LLM) are indeed capable of understanding and answering questions about structured data such as graphs. This new paradigm can…
ReCo: Reminder Composition Mitigates Hallucinations in Vision-Language Models
Sotirios Panagiotis Chytas, Miso Choi, Hyunwoo J. Kim +1
Vision Language Models (VLMs) show impressive capabilities in integrating and reasoning with both visual and language data. But these models make mistakes. A common finding -- simi…
Pooling Image Datasets With Multiple Covariate Shift and Imbalance
Sotirios Panagiotis Chytas, Vishnu Suresh Lokhande, Peiran Li +1
Small sample sizes are common in many disciplines, which necessitates pooling roughly similar datasets across multiple institutions to study weak but relevant associations between…