activity
20172022
most citedOn Identifiability in Transformers

77 citations · 108 across the 6 of their papers we have counts for

collaborators

7 papers

cs.GR2022

Automating Rigid Origami Design

Jeremia Geiger, Karolis Martinkus, Oliver Richter +1

Rigid origami has shown potential in large diversity of practical applications. However, current rigid origami crease pattern design mostly relies on known tessellations. This stro…

cs.LG2020★ 11 cited

Normalized Attention Without Probability Cage

Oliver Richter, Roger Wattenhofer

Attention architectures are widely used; they recently gained renewed popularity with Transformers yielding a streak of state of the art results. Yet, the geometrical implications…

cs.CL2019★ 77 cited

On Identifiability in Transformers

Gino Brunner, Yang Liu, Damián Pascual +3

In this paper we delve deep in the Transformer architecture by investigating two of its core components: self-attention and contextual embeddings. In particular, we study the ident…

cs.LG2019

Attentive Multi-Task Deep Reinforcement Learning

Timo Bram, Gino Brunner, Oliver Richter +1

Sharing knowledge between tasks is vital for efficient learning in a multi-task setting. However, most research so far has focused on the easier case where knowledge transfer is no…

cs.LG2019★ 1 cited

Learning Policies through Quantile Regression

Oliver Richter, Roger Wattenhofer

Policy gradient based reinforcement learning algorithms coupled with neural networks have shown success in learning complex policies in the model free continuous action space contr…

cs.LG2018★ 3 cited

Using State Predictions for Value Regularization in Curiosity Driven Deep Reinforcement Learning

Gino Brunner, Manuel Fritsche, Oliver Richter +1

Learning in sparse reward settings remains a challenge in Reinforcement Learning, which is often addressed by using intrinsic rewards. One promising strategy is inspired by human c…

cs.RO2017★ 16 cited

Teaching a Machine to Read Maps with Deep Reinforcement Learning

Gino Brunner, Oliver Richter, Yuyi Wang +1

The ability to use a 2D map to navigate a complex 3D environment is quite remarkable, and even difficult for many humans. Localization and navigation is also an important problem i…