activity
20172026
most citedZero-Shot Knowledge Distillation in Deep Networks

85 citations · 87 across the 8 of their papers we have counts for

collaborators

11 papers

cs.RO2026

ReCAT: Remember, Count, and Time: Structured Recurrent Memory for Robot Manipulation

Pankhuri Vanjani, Mostafa Hatab, Can Mizrakli +4

Memory-dependent manipulation requires robots to make decisions using information that is no longer available to their current sensors, such as recalling an earlier visual cue, tra…

cs.LG2026

Kalman Linear Attention: Parallel Bayesian Filtering For Efficient Language Modelling and State Tracking

Vaisakh Shaj, Cameron Barker, Aidan Scannell +3

State-space language models such as Mamba and gated linear attention (GLA) offer linear-complexity, parallelisable alternatives to transformers, but their linear state updates limi…

cs.LG2024

Adaptive World Models: Learning Behaviors by Latent Imagination Under Non-Stationarity

Emiliyan Gospodinov, Vaisakh Shaj, Philipp Becker +2

Developing foundational world models is a key research direction for embodied intelligence, with the ability to adapt to non-stationary environments being a crucial criterion. In t…

cs.AI2024

Learning World Models With Hierarchical Temporal Abstractions: A Probabilistic Perspective

Vaisakh Shaj

Machines that can replicate human intelligence with type 2 reasoning capabilities should be able to reason at multiple levels of spatio-temporal abstractions and scales using inter…

cs.LG2023

Multi Time Scale World Models

Vaisakh Shaj, Saleh Gholam Zadeh, Ozan Demir +2

Intelligent agents use internal world models to reason and make predictions about different courses of their actions at many scales. Devising learning paradigms and architectures t…

cs.LG2022★ 1 cited

Hidden Parameter Recurrent State Space Models For Changing Dynamics Scenarios

Vaisakh Shaj, Dieter Buchler, Rohit Sonker +2

Recurrent State-space models (RSSMs) are highly expressive models for learning patterns in time series data and system identification. However, these models assume that the dynamic…

cs.RO2022

End-to-End Learning of Hybrid Inverse Dynamics Models for Precise and Compliant Impedance Control

Moritz Reuss, Niels van Duijkeren, Robert Krug +3

It is well-known that inverse dynamics models can improve tracking performance in robot control. These models need to precisely capture the robot dynamics, which consist of well-un…

cs.RO2020★ 1 cited

Action-Conditional Recurrent Kalman Networks For Forward and Inverse Dynamics Learning

Vaisakh Shaj, Philipp Becker, Dieter Buchler +5

Estimating accurate forward and inverse dynamics models is a crucial component of model-based control for sophisticated robots such as robots driven by hydraulics, artificial muscl…

cs.CV2020

Adversarial Fooling Beyond "Flipping the Label"

Konda Reddy Mopuri, Vaisakh Shaj, R. Venkatesh Babu

Recent advancements in CNNs have shown remarkable achievements in various CV/AI applications. Though CNNs show near human or better than human performance in many critical tasks, t…

cs.LG2019★ 85 cited

Zero-Shot Knowledge Distillation in Deep Networks

Gaurav Kumar Nayak, Konda Reddy Mopuri, Vaisakh Shaj +2

Knowledge distillation deals with the problem of training a smaller model (Student) from a high capacity source model (Teacher) so as to retain most of its performance. Existing ap…

cs.LG2017

Learning Sparse Adversarial Dictionaries For Multi-Class Audio Classification

Vaisakh Shaj, Puranjoy Bhattacharya

Audio events are quite often overlapping in nature, and more prone to noise than visual signals. There has been increasing evidence for the superior performance of representations…