6 papers · 1 filter
Accelerating Speculative Diffusions via Block Verification
Alexander Soen, Hisham Husain, Valentin De Bortoli +1
Speculative decoding speeds up LLM inference by using a draft model to generate tokens, with an acceptance-rejection scheme that ensures that the output matches the target distribu…
Domain Adaptation and Entanglement: an Optimal Transport Perspective
Okan Koç, Alexander Soen, Chao-Kai Chiang +1
Current machine learning systems are brittle in the face of distribution shifts (DS), where the target distribution that the system is tested on differs from the source distributio…
Linking Across Data Granularity: Fitting Multivariate Hawkes Processes to Partially Interval-Censored Data
Pio Calderon, Alexander Soen, Marian-Andrei Rizoiu
The multivariate Hawkes process (MHP) is widely used for analyzing data streams that interact with each other, where events generate new events within their own dimension (via self…
Trade-Offs of Diagonal Fisher Information Matrix Estimators
Alexander Soen, Ke Sun
The Fisher information matrix can be used to characterize the local geometry of the parameter space of neural networks. It elucidates insightful theories and useful tools to unders…
Tempered Calculus for ML: Application to Hyperbolic Model Embedding
Richard Nock, Ehsan Amid, Frank Nielsen +2
Most mathematical distortions used in ML are fundamentally integral in nature: -divergences, Bregman divergences, (regularized) optimal transport distances, integral probability…
pyBregMan: A Python library for Bregman Manifolds
Frank Nielsen, Alexander Soen
A Bregman manifold is a synonym for a dually flat space in information geometry which admits as a canonical divergence a Bregman divergence. Bregman manifolds are induced by smooth…