activity
20192025
most citedLow-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations

5 citations · 18 across the 18 of their papers we have counts for

collaborators

20 papers

math.NA2025

A Galerkin Alternating Projection Method for Kinetic Equations in the Diffusive Limit

Gianluca Ceruti, Nicolas Crouseilles, Lukas Einkemmer

The numerical approximation of high-dimensional evolution equations poses significant computational challenges, particularly in kinetic theory and radiative transfer. In this work,…

math.NA2025

A low-rank, high-order implicit-explicit integrator for three-dimensional convection-diffusion equations

Joseph Nakao, Gianluca Ceruti, Lukas Einkemmer

This paper presents a rank-adaptive implicit-explicit integrator for the tensor approximation of three-dimensional convection-diffusion equations. In particular, the recently devel…

math.NA2024★ 1 cited

A parallel Basis Update and Galerkin Integrator for Tree Tensor Networks

Gianluca Ceruti, Jonas Kusch, Christian Lubich +1

Computing the numerical solution to high-dimensional tensor differential equations can lead to prohibitive computational costs and memory requirements. To reduce the memory and com…

cs.LG2024★ 1 cited

GeoLoRA: Geometric integration for parameter efficient fine-tuning

Steffen Schotthöfer, Emanuele Zangrando, Gianluca Ceruti +2

Low-Rank Adaptation (LoRA) has become a widely used method for parameter-efficient fine-tuning of large-scale, pre-trained neural networks. However, LoRA and its extensions face se…

math.NA2024

Randomized low-rank Runge-Kutta methods

Hei Yin Lam, Gianluca Ceruti, Daniel Kressner

This work proposes and analyzes a new class of numerical integrators for computing low-rank approximations to solutions of matrix differential equation. We combine an explicit Rung…

math.NA2024★ 2 cited

Low-rank Tree Tensor Network Operators for Long-Range Pairwise Interactions

Gianluca Ceruti, Daniel Kressner, Dominik Sulz

Compactly representing and efficently applying linear operators are fundamental ingredients in tensor network methods for simulating quantum many-body problems and solving high-dim…

math.NA2024

A robust second-order low-rank BUG integrator based on the midpoint rule

Gianluca Ceruti, Lukas Einkemmer, Jonas Kusch +1

Dynamical low-rank approximation has become a valuable tool to perform an on-the-fly model order reduction for prohibitively large matrix differential equations. A core ingredient…

math.NA2023

From low-rank retractions to dynamical low-rank approximation and back

Axel Séguin, Gianluca Ceruti, Daniel Kressner

In algorithms for solving optimization problems constrained to a smooth manifold, retractions are a well-established tool to ensure that the iterates stay on the manifold. More rec…

cs.LG2023★ 4 cited

Robust low-rank training via approximate orthonormal constraints

Dayana Savostianova, Emanuele Zangrando, Gianluca Ceruti +1

With the growth of model and data sizes, a broad effort has been made to design pruning techniques that reduce the resource demand of deep learning pipelines, while retaining model…

cs.LG2023★ 1 cited

Geometry-aware training of factorized layers in tensor Tucker format

Emanuele Zangrando, Steffen Schotthöfer, Gianluca Ceruti +2

Reducing parameter redundancies in neural network architectures is crucial for achieving feasible computational and memory requirements during training and inference phases. Given…

cond-mat.stat-mech2023★ 2 cited

Numerical simulations of long-range open quantum many-body dynamics with tree tensor networks

Dominik Sulz, Christian Lubich, Gianluca Ceruti +2

Open quantum systems provide a conceptually simple setting for the exploration of collective behavior stemming from the competition between quantum effects, many-body interactions,…

math.NA2023★ 2 cited

A parallel rank-adaptive integrator for dynamical low-rank approximation

Gianluca Ceruti, Jonas Kusch, Christian Lubich

This work introduces a parallel and rank-adaptive matrix integrator for dynamical low-rank approximation. The method is related to the previously proposed rank-adaptive basis updat…

cs.LG2022★ 5 cited

Low-rank lottery tickets: finding efficient low-rank neural networks via matrix differential equations

Steffen Schotthöfer, Emanuele Zangrando, Jonas Kusch +2

Neural networks have achieved tremendous success in a large variety of applications. However, their memory footprint and computational demand can render them impractical in applica…

math.NA2022

Rank-adaptive time integration of tree tensor networks

Gianluca Ceruti, Christian Lubich, Dominik Sulz

A rank-adaptive integrator for the approximate solution of high-order tensor differential equations by tree tensor networks is proposed and analyzed. In a recursion from the leaves…

math.NA2021

On the stability of robust dynamical low-rank approximations for hyperbolic problems

Jonas Kusch, Lukas Einkemmer, Gianluca Ceruti

The dynamical low-rank approximation (DLRA) is used to treat high-dimensional problems that arise in such diverse fields as kinetic transport and uncertainty quantification. Even t…

math.NA2021

Dynamical low-rank approximation for Burgers' equation with uncertainty

Jonas Kusch, Gianluca Ceruti, Lukas Einkemmer +1

Quantifying uncertainties in hyperbolic equations is a source of several challenges. First, the solution forms shocks leading to oscillatory behaviour in the numerical approximatio…

math.NA2021

A rank-adaptive robust integrator for dynamical low-rank approximation

Gianluca Ceruti, Jonas Kusch, Christian Lubich

A rank-adaptive integrator for the dynamical low-rank approximation of matrix and tensor differential equations is presented. The fixed-rank integrator recently proposed by two of…

math.NA2020

An unconventional robust integrator for dynamical low-rank approximation

Gianluca Ceruti, Christian Lubich

We propose and analyse a numerical integrator that computes a low-rank approximation to large time-dependent matrices that are either given explicitly via their increments or are t…

math.NA2020

Time integration of tree tensor networks

Gianluca Ceruti, Christian Lubich, Hanna Walach

Dynamical low-rank approximation by tree tensor networks is studied for the data-sparse approximation to large time-dependent data tensors and unknown solutions of tensor different…

math.NA2019

Time integration of symmetric and anti-symmetric low-rank matrices and Tucker tensors

Gianluca Ceruti, Christian Lubich

A numerical integrator is presented that computes a symmetric or skew-symmetric low-rank approximation to large symmetric or skew-symmetric time-dependent matrices that are either…