5 papers
Structured Representation Learning with Locally Linear Embeddings and Adaptive Feature Fusion
Somjit Nath, Jackson J Cone, Derek Nowrouzezahrai +1
Neuroscientific research has revealed that the brain encodes complex behaviors by leveraging structured, low-dimensional manifolds and dynamically fusing multiple sources of inform…
The Invisible Hand of Physics: When Video Diffusion Models Know More Than They Show
Parsa Esmati, Somjit Nath, Katja Hofmann +3
Modern video diffusion models generate increasingly realistic and temporally coherent videos, motivating their use as candidate world simulators. Yet it remains unclear whether the…
Generative Point Tracking with Flow Matching
Mattie Tesfaldet, Adam W. Harley, Konstantinos G. Derpanis +2
Tracking a point through a video can be a challenging task due to uncertainty arising from visual obfuscations, such as appearance changes and occlusions. Although current state-of…
Learnable Fractal Flames
Jordan J. Bannister, Derek Nowrouzezahrai
This work presents a differentiable rendering approach that allows latent fractal flame parameters to be learned from image supervision using gradient descent optimization. The app…
Reinforcement Learning for Sequence Design Leveraging Protein Language Models
Jithendaraa Subramanian, Shivakanth Sujit, Niloy Irtisam +4
Protein sequence design, determined by amino acid sequences, are essential to protein engineering problems in drug discovery. Prior approaches have resorted to evolutionary strateg…