1 citations · 2 across the 10 of their papers we have counts for
5 papers · 1 filter
Thinking Leakage: A Causal Audit of NoThink Post-Training in Hybrid Reasoning Models
Zehao Liu, Vasant G. Honavar
Post-training hybrid reasoning models in NoThink mode has attracted growing interest as a way to improve performance while keeping inference fast. However, these gains may draw on…
Parameter-free Adaptive Sparse Attention via Compression-Based Content Selection
Debarshi Kundu, Swaroop Ghosh, Vasant Honavar
Data-adaptive sparse attention masks substantially outperform fixed patterns (e.g., BigBird and Longformer) and can even exceed dense attention on long sequences. Existing adaptive…
Restoring the Sweet Spot: Pass-Rate Weighted Self-Distillation for LLM Reasoning
Zehao Liu, Yuanpu Cao, Jinghui Chen +1
Self-Distillation Policy Optimization (SDPO) provides dense token-level credit assignment for reinforcement learning with large language models by leveraging the model's own feedba…
Projection-Free Transformers via Gaussian Kernel Attention
Debarshi Kundu, Archisman Ghosh, Swaroop Ghosh +1
Self-attention in Transformers is typically implemented as , where , , and are learned linear projections of the input…
Hyperdimensional Cross-Modal Alignment of Frozen Language and Image Models for Efficient Image Captioning
Abhishek Dalvi, Vasant Honavar
Large unimodal foundation models for vision and language encode rich semantic structures, yet aligning them typically requires computationally intensive multimodal fine-tuning. Suc…