1 citations · 3 across the 16 of their papers we have counts for
5 papers · 1 filter
DKL: Decoupled Knowledge Learning for Instruction-Tuned Language Models
Kushagra Bhushan, Meghanadh Pulivarthi, Sai Krishna Reddy Sathi +7
RAG has become the de facto method for incorporating new, corpus-specific knowledge into an instruction following LLM (Instruct LLM). Although RAG-based prompting improves factual…
KItCAT: Knowledge Injection via Input Corruption for Auto-regressive Training
Meghanadh Pulivarthi, Kushagra Bhushan, Vineet Kumar +5
LLMs acquire vast amounts of knowledge during pre-training, but often lack the specialized knowledge needed to answer questions from niche sources such as manuals or technical docu…
LMK > CLS: Landmark Pooling for Dense Embeddings
Meet Doshi, Aashka Trivedi, Vishwajeet Kumar +5
Representation learning is central to many downstream tasks such as search, clustering, classification, and reranking. State-of-the-art sequence encoders typically collapse a varia…
Granite Embedding R2 Models
Parul Awasthy, Aashka Trivedi, Yulong Li +17
We introduce the Granite Embedding R2 models, a comprehensive family of high-performance English encoder-based embedding models engineered for enterprise-scale dense retrieval appl…
MILU: A Multi-task Indic Language Understanding Benchmark
Sshubam Verma, Mohammed Safi Ur Rahman Khan, Vishwajeet Kumar +2
Evaluating Large Language Models (LLMs) in low-resource and linguistically diverse languages remains a significant challenge in NLP, particularly for languages using non-Latin scri…