2 citations · 2 across the 3 of their papers we have counts for
4 papers
FlashMask-3: Efficient and Expressive Mask-Aware Distributed Attention
Guoxia Wang, Qianyue He, Siming Wu +6
Long-context training of large language and multimodal models couples structured attention masks (document, prefix-LM, share-question, sliding-window, block-sparse) with multi-node…
ERNIE 5.0 Technical Report
Haifeng Wang, Hua Wu, Tian Wu +432
In this report, we introduce ERNIE 5.0, a natively autoregressive foundation model desinged for unified multimodal understanding and generation across text, image, video, and audio…
EulerESG: Automating ESG Disclosure Analysis with LLMs
Yi Ding, Xushuo Tang, Zhengyi Yang +13
Environmental, Social, and Governance (ESG) reports have become central to how companies communicate climate risk, social impact, and governance practices, yet they are still publi…
FlashMask: Efficient and Rich Mask Extension of FlashAttention
Guoxia Wang, Jinle Zeng, Xiyuan Xiao +7
The computational and memory demands of vanilla attention scale quadratically with the sequence length , posing significant challenges for processing long sequences in Transform…