2 papers
cs.CV2026
MMLongEmbed: Benchmarking Multimodal Embedding Models in Long-Context Scenarios
Haitian Wang, Ruoxi Sun, Quantong Qiu +5
Recent advancements have significantly expanded the theoretical context windows of Multimodal Embedding Models (MEMs). However, larger context windows do not necessarily translate…
cs.LG2026
Flux Attention: Context-Aware Hybrid Attention for Efficient LLMs Inference
Quantong Qiu, Zhiyi Hong, Yi Yang +5
The quadratic computational complexity of standard attention mechanisms presents a severe scalability bottleneck for LLMs in long-context scenarios. While hybrid attention mechanis…