52 citations · 56 across the 8 of their papers we have counts for
Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Rethinking the shape convention of an MLP
Meng-Hsi Chen, Yu-Ang Lee, Feng-Ting Liao +1
Multi-layer perceptrons (MLPs) conventionally follow a narrow-wide-narrow design where skip connections operate at the input/output dimensions while processing occurs in expanded h…
cs.LG2025
Latent Flow Transformer
Yen-Chen Wu, Feng-Ting Liao, Meng-Hsi Chen +3
Transformers, the standard implementation for large language models (LLMs), typically consist of tens to hundreds of discrete layers. While more layers can lead to better performan…