5 citations · 7 across the 8 of their papers we have counts for
Showing 2026Show all
2 papers · 1 filter
cs.CL2026
UltraBERT: Beyond the Limit of BERT Pre-Training
Jungwoo Park, Taewhoo Lee, Jaewoo Kang
Recent bidirectional encoders have been modernized with innovations from causal large language models (LLMs). However, the pretraining recipe itself remains inherited from small-sc…
cs.CL2026
Solar Open 2 Technical Report
Sungrae Park, Sanghoon Kim, Gyoungjin Gim +50
We present Solar Open 2, a 250B-A15B Mixture-of-Experts language model built for long-horizon agentic tasks, scaled up from Solar Open 1 (Solar Open 100B). To hold entire agent tra…