1 citations · 1 across the 11 of their papers we have counts for
4 papers · 1 filter
Can an LLM Induce a Graph? Investigating Memory Drift and Context Length
Raquib Bin Yousuf, Aadyant Khatri, Shengzhe Xu +2
Recently proposed evaluation benchmarks aim to characterize the effective context length and the forgetting tendencies of large language models (LLMs). However, these benchmarks of…
When can isotropy help adapt LLMs' next word prediction to numerical domains?
Rashed Shelim, Shengzhe Xu, Walid Saad +1
Vector representations of contextual embeddings learned by pre-trained large language models (LLMs) are effective in various downstream tasks in numerical domains such as time seri…
LLM Augmentations to support Analytical Reasoning over Multiple Documents
Raquib Bin Yousuf, Nicholas Defelice, Mandar Sharma +2
Building on their demonstrated ability to perform a variety of tasks, we investigate the application of large language models (LLMs) to enhance in-depth analytical reasoning within…
Information Guided Regularization for Fine-tuning Language Models
Mandar Sharma, Nikhil Muralidhar, Shengzhe Xu +2
The pretraining-fine-tuning paradigm has been the de facto strategy for transfer learning in modern language modeling. With the understanding that task adaptation in LMs is often a…