5 papers
TailLoR: Protecting Principal Components in Parameter-Efficient Continual Learning
Marius Dragoi, Ioana Pintilie, Alexandra Dragomir +2
Parameter-efficient finetuning methods based on spectral decomposition have enabled progress in Continual Learning. In this paper we introduce TailLoR, which utilizes the singular…
JumpLoRA: Sparse Adapters for Continual Learning in Large Language Models
Alexandra Dragomir, Ioana Pintilie, Antonio Barbalau +6
Adapter-based methods have become a cost-effective approach to continual learning (CL) for Large Language Models (LLMs), by sequentially learning a low-rank update matrix for each…
Closing the gap on tabular data with Fourier and Implicit Categorical Features
Marius Dragoi, Florin Gogianu, Elena Burceanu
While Deep Learning has demonstrated impressive results in applications on various data types, it continues to lag behind tree-based methods when applied to tabular data, often ref…
C-ing Clearly: Enhanced Binary Code Explanations using C code
Teodor Poncu, Ioana Pintilie, Marius Dragoi +2
Large Language Models (LLMs) typically excel at coding tasks involving high-level programming languages, as opposed to lower-level programming languages, such as assembly. We propo…
Beyond Pass@k: Breadth-Depth Metrics for Reasoning Boundaries
Marius Dragoi, Ioana Pintilie, Florin Gogianu +1
Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a powerful paradigm to improve Large Language Models on reasoning tasks such as coding, math or logic. To asses…