4 papers · 1 filter
Heterogeneous Parallelism for Multimodal Large Language Model Training
Yashaswi Karnati, Kamran Jafari, Akash Mehra +10
Foundation model training is becoming multimodal, from post-training pipelines to large-scale pretraining. As modality coverage broadens, context windows grow, and encoder LLM scal…
Gated Graph Attention Networks with Learnable Temperature
Zhongtian Ma, Hao Wu, Yexin Zhang +2
Graph attention networks learn neighbor importance through data-dependent coefficients, but standard layers lack explicit control over unreliable feature dimensions and use fixed s…
HabitatAgent: An End-to-End Multi-Agent System for Housing Consultation
Hongyang Yang, Yanxin Zhang, Yang She +5
Housing selection is a high-stakes and largely irreversible decision problem. We study housing consultation as a decision-support interface for housing selection. Existing housing…
Step-3 is Large yet Affordable: Model-system Co-design for Cost-effective Decoding
StepFun, :, Bin Wang +195
Large language models (LLMs) face low hardware efficiency during decoding, especially for long-context reasoning tasks. This paper introduces Step-3, a 321B-parameter VLM with hard…