3 papers
cs.CL2026
LoRA-Squeeze: Simple and Effective Post-Tuning and In-Tuning Compression of LoRA Modules
Ivan VuliÄ, Adam Grycner, Quentin de Laroussilhe +1
Despite its huge number of variants, standard Low-Rank Adaptation (LoRA) is still a dominant technique for parameter-efficient fine-tuning (PEFT). Nonetheless, it faces persistent…
cs.IR2025
Application Of Large Language Models For The Extraction Of Information From Particle Accelerator Technical Documentation
Qing Dai, Rasmus Ischebeck, Maruisz Sapinski +1
The large set of technical documentation of legacy accelerator systems, coupled with the retirement of experienced personnel, underscores the urgent need for efficient methods to p…
cs.CV2024
PaliGemma: A versatile 3B VLM for transfer
Lucas Beyer, Andreas Steiner, André Susano Pinto +32
PaliGemma is an open Vision-Language Model (VLM) that is based on the SigLIP-So400m vision encoder and the Gemma-2B language model. It is trained to be a versatile and broadly know…