91 citations · 254 across the 20 of their papers we have counts for
3 papers · 1 filter
BayesPrompt: human readable prompts that make sense
Franky Kevin Nando Tezoh, Ali Hussaini Umar, Alessandro Laio +2
Reconstructing prompts that can elicit a desired answer or behaviour in an LLM is an open and important research topic. Optimisation methods which aim at minimising the perplexity…
A quantitative analysis of semantic information in deep representations of text and images
Santiago Acevedo, Andrea Mascaretti, Riccardo Rende +3
It was recently observed that the representations of different models that process identical or semantically related inputs tend to align. We analyze this phenomenon using the Info…
A distributional simplicity bias in the learning dynamics of transformers
Riccardo Rende, Federica Gerace, Alessandro Laio +1
The remarkable capability of over-parameterised neural networks to generalise effectively has been explained by invoking a ``simplicity bias'': neural networks prevent overfitting…