5 papers · 2 filters
Length Representations in Large Language Models
Sangjun Moon, Dasom Choi, Jingun Kwon +2
Large language models (LLMs) have shown remarkable capabilities across various tasks, that are learned from massive amounts of text-based data. Although LLMs can control output seq…
CodeNER: Code Prompting for Named Entity Recognition
Sungwoo Han, Hyeyeon Kim, Jingun Kwon +2
Recent studies have explored various approaches for treating candidate named entity spans as both source and target sequences in named entity recognition (NER) by leveraging large…
Diversity of Transformer Layers: One Aspect of Parameter Scaling Laws
Hidetaka Kamigaito, Ying Zhang, Jingun Kwon +3
Transformers deliver outstanding performance across a wide range of tasks and are now a dominant backbone architecture for large language models (LLMs). Their task-solving performa…
TextTIGER: Text-based Intelligent Generation with Entity Prompt Refinement for Text-to-Image Generation
Shintaro Ozaki, Tomoyuki Jinno, Kazuki Hayashi +6
When generating images from prompts that include specific entities, the model must retain as much entity-specific knowledge as possible. However, the number of entities is almost c…
Considering Length Diversity in Retrieval-Augmented Summarization
Juseon-Do, Jaesung Hwang, Jingun Kwon +2
This study investigates retrieval-augmented summarization by specifically examining the impact of exemplar summary lengths under length constraints, not covered by previous work. W…