9 citations · 11 across the 6 of their papers we have counts for
5 papers · 1 filter
How Calibration Content Shapes Attention-Based Reranking
Petros Karypis, Hossein Rajaby Faghihi, Peter Chen +4
Attention-based rerankers score documents by aggregating query-to-document attention and subtracting a null-query calibration pass to remove positional and structural bias. Althoug…
Fine-Tuning Language Models on Multiple Datasets for Citation Intention Classification
Zeren Shui, Petros Karypis, Daniel S. Karls +4
Citation intention Classification (CIC) tools classify citations by their intention (e.g., background, motivation) and assist readers in evaluating the contribution of scientific l…
Pack of LLMs: Model Fusion at Test-Time via Perplexity Optimization
Costas Mavromatis, Petros Karypis, George Karypis
Fusing knowledge from multiple Large Language Models (LLMs) can combine their diverse strengths to achieve improved performance on a given task. However, current fusion approaches…
SemPool: Simple, robust, and interpretable KG pooling for enhancing language models
Costas Mavromatis, Petros Karypis, George Karypis
Knowledge Graph (KG) powered question answering (QA) performs complex reasoning over language semantics as well as knowledge facts. Graph Neural Networks (GNNs) learn to aggregate…
Extending Input Contexts of Language Models through Training on Segmented Sequences
Petros Karypis, Julian McAuley, George Karypis
Effectively training language models on long inputs poses many technical challenges. As a cost consideration, languages models are pretrained on a fixed sequence length before bein…