activity
20212024
most citedThe Topological BERT: Transforming Attention into Topology for Natural Language Processing

12 citations · 21 across the 5 of their papers we have counts for

collaborators

5 papers

cs.CL2024

Cross-lingual Human-Preference Alignment for Neural Machine Translation with Direct Quality Optimization

Kaden Uhlig, Joern Wuebker, Raphael Reinauer +1

Reinforcement Learning from Human Feedback (RLHF) and derivative techniques like Direct Preference Optimization (DPO) are task-alignment algorithms used to repurpose general, found…

cs.CL2023★ 3 cited

Neural Machine Translation Models Can Learn to be Few-shot Learners

Raphael Reinauer, Patrick Simianer, Kaden Uhlig +2

The emergent ability of Large Language Models to use a small number of examples to learn to perform in novel domains and tasks, also called in-context learning (ICL). In this work,…

cs.CL2023

Early Warning Signals of Social Instabilities in Twitter Data

Vahid Shamsaddini, Henry Kirveslahti, Raphael Reinauer +3

The goal of this project is to create and study novel techniques to identify early warning signals for socially disruptive events, like riots, wars, or revolutions using only publi…

cs.CL2022★ 12 cited

The Topological BERT: Transforming Attention into Topology for Natural Language Processing

Ilan Perez, Raphael Reinauer

In recent years, the introduction of the Transformer models sparked a revolution in natural language processing (NLP). BERT was one of the first text encoders using only the attent…

cs.LG2021★ 6 cited

Persformer: A Transformer Architecture for Topological Machine Learning

Raphael Reinauer, Matteo Caorsi, Nicolas Berkouk

One of the main challenges of Topological Data Analysis (TDA) is to extract features from persistent diagrams directly usable by machine learning algorithms. Indeed, persistence di…