Showing cs.CLShow all
2 papers · 1 filter
cs.CL2025
History-Aware Cross-Attention Reinforcement: Self-Supervised Multi Turn and Chain-of-Thought Fine-Tuning with vLLM
Andrew Kiruluta, Andreas Lemos, Priscilla Burity
We present CAGSR-vLLM-MTC, an extension of our Self-Supervised Cross-Attention-Guided Reinforcement (CAGSR) framework, now implemented on the high-performance vLLM runtime, to addr…
cs.CL2025
Beyond Self Attention: A Subquadratic Fourier Wavelet Transformer with Multi Modal Fusion
Andrew Kiruluta, Andreas Lemos, Eric Lundy
We revisit the use of spectral techniques to replaces the attention mechanism in Transformers through Fourier Transform based token mixing, and present a comprehensive and novel re…