activity
20212026
most citedWECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models

27 citations · 34 across the 8 of their papers we have counts for

collaborators

9 papers

cs.CL2026

Shieldstral

Antonia Calvi, Avinash Sooriyarachchi, Giada Pistilli +273

We introduce Shieldstral, a 3B-parameter policy-adaptive multimodal safety classifier that matches or outperforms models nearly 7 its size on text safety benchmarks and set…

cs.CE2025

Going with the Speed of Sound: Pushing Neural Surrogates into Highly-turbulent Transonic Regimes

Fabian Paischer, Leo Cotteleer, Yann Dreze +5

The widespread use of neural surrogates in automotive aerodynamics, enabled by datasets such as DrivAerML and DrivAerNet++, has primarily focused on bluff-body flows with large wak…

physics.plasm-ph2025

GyroSwin: 5D Surrogates for Gyrokinetic Plasma Turbulence Simulations

Fabian Paischer, Gianluca Galletti, William Hornsby +5

Nuclear fusion plays a pivotal role in the quest for reliable and sustainable energy production. A major roadblock to viable fusion power is understanding plasma turbulence, which…

cs.IR2024

Unifying Generative and Dense Retrieval for Sequential Recommendation

Liu Yang, Fabian Paischer, Kaveh Hassani +11

Sequential dense retrieval models utilize advanced sequence learning techniques to compute item and user representations, which are then used to rank relevant items for a user thro…

cs.IR2024

Preference Discerning with LLM-Enhanced Generative Retrieval

Fabian Paischer, Liu Yang, Linfeng Liu +12

In sequential recommendation, models recommend items based on user's interaction history. To this end, current models usually incorporate information such as item descriptions and…

cs.LG2024

Parameter Efficient Fine-tuning via Explained Variance Adaptation

Fabian Paischer, Lukas Hauzenberger, Thomas Schmied +3

Foundation models (FMs) are pre-trained on large-scale datasets and then fine-tuned for a specific downstream task. The most common fine-tuning method is to update pretrained weigh…

cs.LG2022★ 3 cited

Reactive Exploration to Cope with Non-Stationarity in Lifelong Reinforcement Learning

Christian Steinparz, Thomas Schmied, Fabian Paischer +5

In lifelong learning, an agent learns throughout its entire life without resets, in a constantly changing environment, as we humans do. Consequently, lifelong learning comes with a…

cs.LG2022★ 4 cited

History Compression via Language Models in Reinforcement Learning

Fabian Paischer, Thomas Adler, Vihang Patil +5

In a partially observable Markov decision process (POMDP), an agent typically uses a representation of the past to approximate the underlying MDP. We propose to utilize a frozen Pr…

cs.CL2021★ 27 cited

WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models

Benjamin Minixhofer, Fabian Paischer, Navid Rekabsaz

Large pretrained language models (LMs) have become the central building block of many NLP applications. Training these models requires ever more computational resources and most of…