Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Learning Rate Transfer for Hybrid Transformer-SSM Architectures
Jimin Seo, Gyubok Lee, Yeonsik Jo +11
We study learning rate (LR) scaling for hybrid architectures combining Transformer and State-Space Model (SSM) blocks, a class adopted by several recent production language models.…
cs.LG2026
Mechanistic Circuit Identification for Controllable Data Generation
Nakyung Lee, Sangwoo Hong, Jungwoo Lee
While recent advances in data synthesis aim to curate high-quality datasets, most generation pipelines still rely on heuristic prompt-based control. This black-box paradigm provide…