most citedLanguage Modeling on a SpiNNaker 2 Neuromorphic Chip

10 citations · 13 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CV2024

Latent Representation Matters: Human-like Sketches in One-shot Drawing Tasks

Victor Boutin, Rishav Mukherji, Aditya Agrawal +4

Humans can effortlessly draw new categories from a single exemplar, a feat that has long posed a challenge for generative models. However, this gap has started to close with recent…

cs.LG2024

Weight Sparsity Complements Activity Sparsity in Neuromorphic Language Models

Rishav Mukherji, Mark Schöne, Khaleelulla Khan Nazeer +3

Activity and parameter sparsity are two standard methods of making neural networks computationally more efficient. Event-based architectures such as spiking neural networks (SNNs)…

cs.NE2024★ 10 cited

Language Modeling on a SpiNNaker 2 Neuromorphic Chip

Khaleelulla Khan Nazeer, Mark Schöne, Rishav Mukherji +4

As large language models continue to scale in size rapidly, so too does the computational power required to run them. Event-based networks on neuromorphic devices offer a potential…

cs.LG2023★ 1 cited

Activity Sparsity Complements Weight Sparsity for Efficient RNN Inference

Rishav Mukherji, Mark Schöne, Khaleelulla Khan Nazeer +2

Artificial neural networks open up unprecedented machine learning capabilities at the cost of ever growing computational requirements. Sparsifying the parameters, often achieved th…

cs.AI2023★ 2 cited

Diffusion Models as Artists: Are we Closing the Gap between Humans and Machines?

Victor Boutin, Thomas Fel, Lakshya Singhal +4

An important milestone for AI is the development of algorithms that can produce drawings that are indistinguishable from those of humans. Here, we adapt the 'diversity vs. recogniz…