2 papers
cs.CV2025
CS-VLM: Compressed Sensing Attention for Efficient Vision-Language Representation Learning
Andrew Kiruluta, Preethi Raju, Priscilla Burity
Vision-Language Models (vLLMs) have emerged as powerful architectures for joint reasoning over visual and textual inputs, enabling breakthroughs in image captioning, cross modal re…
cs.LG2025
Breaking Quadratic Barriers: A Non-Attention LLM for Ultra-Long Context Horizons
Andrew Kiruluta, Preethi Raju, Priscilla Burity
We present a novel non attention based architecture for large language models (LLMs) that efficiently handles very long context windows, on the order of hundreds of thousands to po…