1 citations · 1 across the 9 of their papers we have counts for
4 papers · 1 filter
LUCID: Attention with Preconditioned Representations
Sai Surya Duvvuri, Nirmal Patel, Nilesh Gupta +1
Softmax-based dot-product attention is a cornerstone of Transformer architectures, enabling remarkable capabilities such as in-context learning. However, as context lengths increas…
Compressing Many-Shots in In-Context Learning
Devvrit Khatri, Pranamya Kulkarni, Nilesh Gupta +9
Large Language Models (LLMs) have been shown to be able to learn different tasks without explicit finetuning when given many input-output examples / demonstrations through In-Conte…
Dual-Encoders for Extreme Multi-Label Classification
Nilesh Gupta, Devvrit Khatri, Ankit S Rawat +3
Dual-encoder (DE) models are widely used in retrieval tasks, most commonly studied on open QA benchmarks that are often characterized by multi-class and limited training data. In c…
EHI: End-to-end Learning of Hierarchical Index for Efficient Dense Retrieval
Ramnath Kumar, Anshul Mittal, Nilesh Gupta +3
Dense embedding-based retrieval is widely used for semantic search and ranking. However, conventional two-stage approaches, involving contrastive embedding learning followed by app…