activity
20192024
most citedScalable Model Compression by Entropy Penalized Reparameterization

8 citations · 26 across the 9 of their papers we have counts for

collaborators

9 papers

cs.LG2024

Graph Neural Networks Gone Hogwild

Olga Solodova, Nick Richardson, Deniz Oktay +1

Graph neural networks (GNNs) appear to be powerful tools to learn state representations for agents in distributed, decentralized multi-agent systems, but generate catastrophically…

math.NA2023

A rapid and automated computational approach to the design of multistable soft actuators

Mehran Mirramezani, Deniz Oktay, Ryan P. Adams

We develop an automated computational modeling framework for rapid gradient-based design of multistable soft mechanical structures composed of non-identical bistable unit cells wit…

cs.CE2023★ 1 cited

JAX FDM: A differentiable solver for inverse form-finding

Rafael Pastrana, Deniz Oktay, Ryan P. Adams +1

We introduce JAX FDM, a differentiable solver to design mechanically efficient shapes for 3D structures conditioned on target architectural, fabrication and structural properties.…

astro-ph.SR2023★ 3 cited

Minuscule corrections to near-surface solar internal rotation using mode-coupling

Srijan Bharati Das, Samarth G. Kashyap, Deniz Oktay +2

The observed solar oscillation spectrum is influenced by internal perturbations such as flows and structural asphericities. These features induce splitting of characteristic freque…

cs.LG2023

Neuromechanical Autoencoders: Learning to Couple Elastic and Neural Network Nonlinearity

Deniz Oktay, Mehran Mirramezani, Eder Medina +1

Intelligent biological systems are characterized by their embodiment in a complex environment and the intimate interplay between their nervous systems and the nonlinear mechanical…

cs.LG2022★ 2 cited

Meta-PDE: Learning to Solve PDEs Quickly Without a Mesh

Tian Qin, Alex Beatson, Deniz Oktay +2

Partial differential equations (PDEs) are often computationally challenging to solve, and in many settings many related PDEs must be be solved either at every timestep or for a var…

cs.LG2020★ 8 cited

Randomized Automatic Differentiation

Deniz Oktay, Nick McGreivy, Joshua Aduol +2

The successes of deep learning, variational inference, and many other fields have been aided by specialized implementations of reverse-mode automatic differentiation (AD) to comput…

cs.LG2019★ 4 cited

On Predictive Information in RNNs

Zhe Dong, Deniz Oktay, Ben Poole +1

Certain biological neurons demonstrate a remarkable capability to optimally compress the history of sensory inputs while being maximally informative about the future. In this work,…

cs.LG2019★ 8 cited

Scalable Model Compression by Entropy Penalized Reparameterization

Deniz Oktay, Johannes Ballé, Saurabh Singh +1

We describe a simple and general neural network weight compression approach, in which the network parameters (weights and biases) are represented in a "latent" space, amounting to…