10 citations · 20 across the 10 of their papers we have counts for
12 papers
Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does So
Mark Oskin
A transformer's answer lives on one axis: the direction its unembedding reads. Its intermediate states largely do not, and that off-axis position is usually treated as an obstacle…
Training, Reading, and Editing Legible Transformers
Mark Oskin
A transformer can be built from operators that are legible by construction -- bounded, named units that read as fuzzy set operations rather than dense activations -- but legibility…
Legible-by-Construction: Attention and End-to-End Transformers
Mark Oskin
A companion paper showed that a transformer's feed-forward layer can be rebuilt from explicit fuzzy set operations - intersection, set-difference, and a self-forgetting sequence qu…
Explicit Fuzzy Logic in the Feed-Forward Layer: Self-Forgetting Quantifiers Discover Legible Grammatical-Licensing Detectors
Mark Oskin
A transformer's feed-forward (FFN) sublayer materializes the distinctions attention gathers, yet gives no account of what it computes. In a parameter-neutral replacement, each hidd…
The BlackParrot BedRock Cache Coherence System
Mark Wyse, Daniel Petrisko, Farzam Gilani +7
This paper presents BP-BedRock, the open-source cache coherence protocol and system implemented within the BlackParrot 64-bit RISC-V multicore processor. BP-BedRock implements the…
Accelerating Variational Quantum Algorithms Using Circuit Concurrency
Salonik Resch, Anthony Gutierrez, Joon Suk Huh +5
Variational quantum algorithms (VQAs) provide a promising approach to achieve quantum advantage in the noisy intermediate-scale quantum era. In this era, quantum computers experien…
Vignette: Perceptual Compression for Video Storage and Processing Systems
Amrita Mazumdar, Brandon Haynes, Magdalena Balazinska +3
Compressed videos constitute 70% of Internet traffic, and video upload growth rates far outpace compute and storage improvement trends. Past work in leveraging perceptual cues like…
Stochastic Synthesis for Stochastic Computing
Vincent T. Lee, Armin Alaghi, Luis Ceze +1
Stochastic computing (SC) is an emerging computing technique which offers higher computational density, and lower power over binary-encoded (BE) computation. Unlike BE computation,…
Exploring Computation-Communication Tradeoffs in Camera Systems
Amrita Mazumdar, Thierry Moreau, Sung Kim +5
Cameras are the defacto sensor. The growing demand for real-time and low-power computer vision, coupled with trends towards high-efficiency heterogeneous systems, has given rise to…
GPU System Calls
Ján Veselý, Arkaprava Basu, Abhishek Bhattacharjee +3
GPUs are becoming first-class compute citizens and are being tasked to perform increasingly complex work. Modern GPUs increasingly support programmability- enhancing features such…
Similarity Search on Automata Processors
Vincent T. Lee, Justin Kotalik, Carlo C. Del Mundo +3
Similarity search is a critical primitive for a wide variety of applications including natural language processing, content-based search, machine learning, computer vision, databas…
Application-Driven Near-Data Processing for Similarity Search
Vincent T. Lee, Amrita Mazumdar, Carlo C. del Mundo +3
Similarity search is a key to a variety of applications including content-based search for images and video, recommendation systems, data deduplication, natural language processing…