2 papers
cs.CL2024
Gaussian Stochastic Weight Averaging for Bayesian Low-Rank Adaptation of Large Language Models
Emre Onal, Klemens Flöge, Emma Caldwell +2
Fine-tuned Large Language Models (LLMs) often suffer from overconfidence and poor calibration, particularly when fine-tuned on small datasets. To address these challenges, we propo…
cs.CL2022
From Hyperbolic Geometry Back to Word Embeddings
Sultan Nurmukhamedov, Thomas Mach, Arsen Sheverdin +1
We choose random points in the hyperbolic disc and claim that these points are already word representations. However, it is yet to be uncovered which point corresponds to which wor…