1 citations · 1 across the 8 of their papers we have counts for
3 papers · 1 filter
MASCing: Configurable Mixture-of-Experts Behavior via Activation Steering Masks
Jona te Lintelo, Lichao Wu, Marina Krček +2
Mixture-of-Experts (MoE) architectures in Large Language Models (LLMs) have significantly reduced inference costs through sparse activation. However, this sparse activation paradig…
Backdoor Attacks on Decentralised Post-Training
Oğuzhan Ersoy, Nikolay Blagoev, Jona te Lintelo +3
Decentralised post-training of large language models utilises data and pipeline parallelism techniques to split the data and the model. Unfortunately, decentralised post-training c…
Backdoor Directions in Vision Transformers
Sengim Karayalcin, Marina Krcek, Pin-Yu Chen +1
This paper investigates how Backdoor Attacks are represented within Vision Transformers (ViTs). By assuming knowledge of the trigger, we identify a specific ``trigger direction'' i…