activity
20182026
most citedAdamP: Slowing Down the Slowdown for Momentum Optimizers on Scale-invariant Weights

81 citations · 414 across the 42 of their papers we have counts for

collaborators
Showing 2024Show all

7 papers · 1 filter

cs.CV2024

MaskRIS: Semantic Distortion-aware Data Augmentation for Referring Image Segmentation

Minhyun Lee, Seungho Lee, Song Park +3

Referring Image Segmentation (RIS) is an advanced vision-language task that involves identifying and segmenting objects within an image as described by free-form text descriptions.…

cs.CL2024

Token-Supervised Value Models for Enhancing Mathematical Problem-Solving Capabilities of Large Language Models

Jung Hyun Lee, June Yong Yang, Byeongho Heo +4

With the rapid advancement of test-time compute search strategies to improve the mathematical problem-solving capabilities of large language models (LLMs), the need for building ro…

cs.CL2024★ 7 cited

HyperCLOVA X Technical Report

Kang Min Yoo, Jaegeun Han, Sookyo In +393

We introduce HyperCLOVA X, a family of large language models (LLMs) tailored to the Korean language and culture, along with competitive capabilities in English, math, and coding. H…

cs.LG2024

Lipsum-FT: Robust Fine-Tuning of Zero-Shot Models Using Random Text Guidance

Giung Nam, Byeongho Heo, Juho Lee

Large-scale contrastive vision-language pre-trained models provide the zero-shot model achieving competitive performance across a range of image classification tasks without requir…

cs.CV2024★ 2 cited

DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs

Donghyun Kim, Byeongho Heo, Dongyoon Han

This paper revives Densely Connected Convolutional Networks (DenseNets) and reveals the underrated effectiveness over predominant ResNet-style architectures. We believe DenseNets'…

cs.CV2024★ 1 cited

Rotary Position Embedding for Vision Transformer

Byeongho Heo, Song Park, Dongyoon Han +1

Rotary Position Embedding (RoPE) performs remarkably on language models, especially for length extrapolation of Transformers. However, the impacts of RoPE on computer vision domain…