7 papers
Three-Phase Transformer
Mohammad R. Abu Ayyash
We present Three-Phase Transformer (3PT), a residual-stream structural prior for decoder-only Transformers on a standard SwiGLU + RMSNorm + RoPE + GQA backbone. The hidden vector i…
Brainstacks: Cross-Domain Cognitive Capabilities via Frozen MoE-LoRA Stacks for Continual LLM Learning
Mohammad R. Abu Ayyash
We present Brainstacks, a modular architecture for continual multi-domain fine-tuning of large language models that packages domain expertise as frozen adapter stacks composing add…
Reply to Comment on "Properties and dynamics of generalized squeezed states"
Sahel Ashhab, Mohammad Ayyash
In our paper [1], our numerical simulations showed that, unlike displacement and conventional squeezing, higher-order squeezing exhibits oscillatory dynamics. Subsequently, Gordill…
Fast Bosonic Control via Multiphoton Qubit-Oscillator Interactions
Noah Gorgichuk, Mohammad Ayyash, Matteo Mariantoni +1
We present a protocol for preparing oscillator states with -fold rotational symmetry, which include many logical codewords for bosonic quantum error correction codes. The protoc…
Multimode Qubit-Conditional Operations via Generalized Cross-Resonance
Mohammad Ayyash
We present a general framework for generating single- and multimode qubit-conditional operations by extending cross-resonant driving to a generalized multimode scheme. This include…
Dispersive regime of multiphoton qubit-oscillator interactions
Mohammad Ayyash, Sahel Ashhab
The dispersive regime of -photon qubit-oscillator interactions is analyzed using Schrieffer-Wolff perturbation theory. Effective Hamiltonians are derived up to the second order…