69 citations · 90 across the 4 of their papers we have counts for
6 papers · 1 filter
A Comprehensive Survey of Contamination Detection Methods in Large Language Models
Mathieu Ravaut, Bosheng Ding, Fangkai Jiao +6
With the rise of Large Language Models (LLMs) in recent years, abundant new opportunities are emerging, but also new challenges, among which contamination is quickly becoming criti…
LOCOST: State-Space Models for Long Document Abstractive Summarization
Florian Le Bronnec, Song Duong, Mathieu Ravaut +6
State-space models are a low-complexity alternative to transformers for encoding long sequences and capturing long-term dependencies. We propose LOCOST: an encoder-decoder architec…
ChatGPT's One-year Anniversary: Are Open-Source Large Language Models Catching up?
Hailin Chen, Fangkai Jiao, Xingxuan Li +5
Upon its release in late 2022, ChatGPT has brought a seismic shift in the entire landscape of AI, both in research and commerce. Through instruction-tuning a large language model (…
On Context Utilization in Summarization with Large Language Models
Mathieu Ravaut, Aixin Sun, Nancy F. Chen +1
Large language models (LLMs) excel in abstractive summarization tasks, delivering fluent and pertinent summaries. Recent advancements have extended their capabilities to handle lon…
PromptSum: Parameter-Efficient Controllable Abstractive Summarization
Mathieu Ravaut, Hailin Chen, Ruochen Zhao +3
Prompt tuning (PT), a parameter-efficient technique that only tunes the additional prompt embeddings while keeping the backbone pre-trained language model (PLM) frozen, has shown p…
A Data-centric Framework for Improving Domain-specific Machine Reading Comprehension Datasets
Iva Bojic, Josef Halim, Verena Suharman +6
Low-quality data can cause downstream problems in high-stakes applications. Data-centric approach emphasizes on improving dataset quality to enhance model performance. High-quality…