4 papers
Gated Recurrent Transformers: Expressive Depth through Recurrent Modulation in Transformers
Amr Hegazy, Amr Alanwar, Mostafa Elhoushi
Scaling transformer language models creates an inherent tension between expressivity and memory efficiency. While unique weights across layers preserve functional specialization---…
Guiding Giants: Lightweight Controllers for Weighted Activation Steering in LLMs
Amr Hegazy, Mostafa Elhoushi, Amr Alanwar
Controlling undesirable Large Language Model (LLM) behaviors, such as the generation of unsafe content or failing to adhere to safety guidelines, often relies on costly fine-tuning…
Online Data-Driven Reachability Analysis using Zonotopic Recursive Least Squares
Alireza Naderi, Alireza Naderi Akhormeh, Amr Hegazy +1
Reachability analysis is a key formal verification technique for ensuring the safety of modern cyber physical systems subject to uncertainties in measurements, system models (param…
Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysis
Ahmad Hafez, Alireza Naderi Akhormeh, Amr Hegazy +1
The deployment of Large Language Models (LLMs) in robotic systems presents unique safety challenges, particularly in unpredictable environments. Although LLMs, leveraging zero-shot…