Showing 2024Show all
2 papers · 1 filter
cs.CV2024
Cross-Attention Head Position Patterns Can Align with Human Visual Concepts in Text-to-Image Generative Models
Jungwon Park, Jungmin Ko, Dongnam Byun +2
Recent text-to-image diffusion models leverage cross-attention layers, which have been effectively utilized to enhance a range of visual generative tasks. However, our understandin…
cs.CL2024
Unveiling Key Aspects of Fine-Tuning in Sentence Embeddings: A Representation Rank Analysis
Euna Jung, Jaeill Kim, Jungmin Ko +2
The latest advancements in unsupervised learning of sentence embeddings predominantly involve employing contrastive learning-based (CL-based) fine-tuning over pre-trained language…