3 citations · 6 across the 5 of their papers we have counts for
5 papers
Recite, Reconstruct, Recollect: Memorization in LMs as a Multifaceted Phenomenon
USVSN Sai Prashanth, Alvin Deng, Kyle O'Brien +9
Memorization in language models is typically treated as a homogenous phenomenon, neglecting the specifics of the memorized data. We instead model memorization as the effect of a se…
Hierarchical World Models as Visual Whole-Body Humanoid Controllers
Nicklas Hansen, Jyothir S, Vlad Sobal +3
Whole-body control for humanoids is challenging due to the high-dimensional nature of the problem, coupled with the inherent instability of a bipedal morphology. Learning from visu…
Gradient-based Planning with World Models
Jyothir S, Siddhartha Jalagam, Yann LeCun +1
The enduring challenge in the field of artificial intelligence has been the control of systems to achieve desired behaviours. While for systems governed by straightforward dynamics…
KEYword based Sampling (KEYS) for Large Language Models
Jyothir S, Zuhaib Akhtar
Question answering (Q/A) can be formulated as a generative task (Mitra, 2017) where the task is to generate an answer given the question and the passage (knowledge, if available).…
Joint Embedding Predictive Architectures Focus on Slow Features
Vlad Sobal, Jyothir S, Siddhartha Jalagam +3
Many common methods for learning a world model for pixel-based environments use generative architectures trained with pixel-level reconstruction objectives. Recently proposed Joint…