Showing 2024Show all
3 papers · 1 filter
cs.LG2024
ROSA: Random Subspace Adaptation for Efficient Fine-Tuning
Marawan Gamal Abdel Hameed, Aristides Milios, Siva Reddy +1
Model training requires significantly more memory, compared with inference. Parameter efficient fine-tuning (PEFT) methods provide a means of adapting large models to downstream ta…
cs.CL2024
A Compositional Typed Semantics for Universal Dependencies
Laurestine Bradford, Timothy John O'Donnell, Siva Reddy
Languages may encode similar meanings using different sentence structures. This makes it a challenge to provide a single set of formal rules that can derive meanings from sentences…
cs.CL2024
When does word order matter and when doesn't it?
Xuanda Chen, Timothy O'Donnell, Siva Reddy
Language models (LMs) may appear insensitive to word order changes in natural language understanding (NLU) tasks. In this paper, we propose that linguistic redundancy can explain t…