5 papers · 1 filter
Enabling Intrinsic Reasoning over Dense Geospatial Embeddings with DFR-Gemma
Xuechen Zhang, Aviv Slobodkin, Joydeep Paul +4
Representation learning for geospatial and spatio-temporal data plays a critical role in enabling general-purpose geospatial intelligence. Recent geospatial foundation models, such…
Can an LLM Induce a Graph? Investigating Memory Drift and Context Length
Raquib Bin Yousuf, Aadyant Khatri, Shengzhe Xu +2
Recently proposed evaluation benchmarks aim to characterize the effective context length and the forgetting tendencies of large language models (LLMs). However, these benchmarks of…
LLM Augmentations to support Analytical Reasoning over Multiple Documents
Raquib Bin Yousuf, Nicholas Defelice, Mandar Sharma +2
Building on their demonstrated ability to perform a variety of tasks, we investigate the application of large language models (LLMs) to enhance in-depth analytical reasoning within…
Laying Anchors: Semantically Priming Numerals in Language Modeling
Mandar Sharma, Rutuja Murlidhar Taware, Pravesh Koirala +2
Off-the-shelf pre-trained language models have become the de facto standard in NLP pipelines for a multitude of downstream tasks. However, the inability of these models to properly…
Information Guided Regularization for Fine-tuning Language Models
Mandar Sharma, Nikhil Muralidhar, Shengzhe Xu +2
The pretraining-fine-tuning paradigm has been the de facto strategy for transfer learning in modern language modeling. With the understanding that task adaptation in LMs is often a…