15 papers
omni-macos: On-Device Omni-Modal Search on Apple Silicon
Han Xiao
A search engine that embeds text, code, documents, images, audio and video into the same representation space has to run its encoder and keep its index somewhere, and almost every…
Cross-Tokenizer On-Policy Distillation via Byte-Prefix Marginalization
Hao Wang, Kun Yuan, Wenlin Zhong +4
Open-weight language models from different families exhibit complementary capabilities, motivating their consolidation into a compact student through on-policy distillation (OPD).…
jina-reranker-v3.5: An Efficient Listwise Reranker with Hybrid Attention and Self-Distillation
Christina Nasika, Feng Wang, Antonis Krasakis +1
Listwise rerankers are the discriminative core of agentic retrieval pipelines, yet production deployment demands efficiency, domain robustness, and fluency on semi-structured data…
Efficient Scaling of LLM Training with Flexible Context Parallelism
Yifan Niu, Han Xiao, Dongyi Liu +2
Scaling long-context capabilities is crucial for Large Language Models (LLMs). However, real-world data contain a large number of sequences with heterogeneous lengths. Existing tra…
jina-embeddings-v5-omni: Geometry-preserving Embeddings via Locked Aligned Towers
Florian Hönicke, Florian Hönicke, Michael Günther +6
In this work, we introduce GELATO (Geometry-preserving Embeddings via Locked Aligned TOwers), a novel approach to multimodal embedding models. We build on the VLM-style architectur…
Test-Time Compute for Frozen Embedding Models through Agentic Program Search
Han Xiao
Test-time compute is widely believed to benefit only large reasoning models, leaving small models with nothing to gain. We argue the opposite for dense retrieval, since modern smal…