4 papers
An Alternative Trajectory for Generative AI
Margarita Belova, Yuval Kansal, Yihao Liang +2
The generative artificial intelligence (AI) ecosystem is undergoing rapid transformations that threaten its sustainability. As models transition from research prototypes to high-tr…
Knowledge Graph-Driven Expert-Level Reasoning for Neuroscience
Jake Stephen, Niraj K. Jha
Knowledge graph (KG) is an abstraction that can be extracted from text corpora and used for in-depth reasoning. Prior work has leveraged KGs to fine-tune language models (LMs), ena…
HEED: Density-Weighted Residual Alignment for Hybrid Vision-Language Model Distillation
Yihao Liang, Niraj K. Jha
Distilling vision-language models into faster hybrid architectures, such as 3:1 Mamba-2/attention mixes, is now standard practice for making inference efficient. Aggregate benchmar…
Uncertainty-Aware Transformers: Conformal Prediction for Language Models
Abhiram Vellore, Niraj K. Jha
Transformers have had a profound impact on the field of artificial intelligence, especially on large language models and their variants. However, as was the case with neural networ…