From the 1 of 8 linked papers with an AI index.
4 papers · 1 filter
Learning in Curved Weight Space:Exponential-Linear Weight Reparameterization for Improved Optimization
Ethan Smith
The paper proposes a new weight reparameterization that combines an exponential and a linear pathway, creating a curved parameter space that enables more proportional updates and s…
NOBLE: Accelerating Transformers with Nonlinear Low-Rank Branches
Ethan Smith
We introduce NOBLE (Nonlinear lOw-rank Branch for Linear Enhancement), an architectural augmentation that adds nonlinear low-rank branches to transformer linear layers. Unlike LoRA…
From Tokens to Numbers: Continuous Number Modeling for SVG Generation
Michael Ogezi, Martin Bell, Freda Shi +1
For certain image generation tasks, vector graphics such as Scalable Vector Graphics (SVGs) offer clear benefits such as increased flexibility, size efficiency, and editing ease, b…
LoRA Diffusion: Zero-Shot LoRA Synthesis for Diffusion Model Personalization
Ethan Smith, Rami Seid, Alberto Hojel +2
Low-Rank Adaptation (LoRA) and other parameter-efficient fine-tuning (PEFT) methods provide low-memory, storage-efficient solutions for personalizing text-to-image models. However,…