54 citations · 55 across the 10 of their papers we have counts for
5 papers · 1 filter
What's New in My Data? Novelty Exploration via Contrastive Generation
Masaru Isonuma, Ivan Titov
Fine-tuning is widely used to adapt language models for specific goals, often leveraging real-world data such as patient records, customer-service interactions, or web content in l…
Post-hoc Disentanglement of Textual and Acoustic Features in Pre-trained Speech Encoders
Hosein Mohebbi, Grzegorz Chrupała, Willem Zuidema +2
Pre-trained speech models build entangled internal representations, which capture a variety of features (e.g., pitch, loudness, syntax, or semantics of an utterance) in a distribut…
Solovay reducibility implies S2a-reducibility
Ivan Titov
The original notion of Solovay reducibility was introduced by Robert M. Solovay (unpublished notes) in 1975 as a measure of relative randomness. The S2a-reducibility introduced by…
Extending the Limit Theorem of Barmpalias and Lewis-Pye to all reals
Ivan Titov
By a celebrated result of Kučera and Slaman (DOI:10.1137/S0097539799357441), the Martin-Löf random left-c.e. reals form the highest left-c.e. Solovay degree. Barmpalias and Lewis-P…
Unlearning Traces the Influential Training Data of Language Models
Masaru Isonuma, Ivan Titov
Identifying the training datasets that influence a language model's outputs is essential for minimizing the generation of harmful content and enhancing its performance. Ideally, we…