127 citations · 127 across the 2 of their papers we have counts for
4 papers
Punctuation-aware Hybrid Trainable Sparse Attention for Large Language Models
Junxiang Qiu, Shuo Wang, Zhengsu Chen +4
Attention serves as the fundamental mechanism for long-context modeling in large language models (LLMs), yet dense attention becomes structurally prohibitive for long sequences due…
Beyond Empathy: Integrating Diagnostic and Therapeutic Reasoning with Large Language Models for Mental Health Counseling
He Hu, Yucheng Zhou, Juzheng Si +6
Large language models (LLMs) hold significant potential for mental health support, capable of generating empathetic responses and simulating therapeutic conversations. However, exi…
Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast
Kaifeng Bi, Lingxi Xie, Hengheng Zhang +3
In this paper, we present Pangu-Weather, a deep learning based system for fast and accurate global weather forecast. For this purpose, we establish a data-driven environment by dow…
Rethinking the Distribution Gap of Person Re-identification with Camera-based Batch Normalization
Zijie Zhuang, Longhui Wei, Lingxi Xie +5
The fundamental difficulty in person re-identification (ReID) lies in learning the correspondence among individual cameras. It strongly demands costly inter-camera annotations, yet…