5 papers
AI Alignment: A Comprehensive Survey
Jiaming Ji, Tianyi Qiu, Boyuan Chen +23
AI alignment aims to make AI systems behave in line with human intentions and values. As AI systems grow more capable, so do risks from misalignment. To provide a comprehensive and…
T3D: Advancing 3D Medical Vision-Language Pre-training by Learning Multi-View Visual Consistency
Che Liu, Cheng Ouyang, Yinda Chen +7
While 3D visual self-supervised learning (vSSL) shows promising results in capturing visual representations, it overlooks the clinical knowledge from radiology reports. Meanwhile,…
Machine learning for modelling unstructured grid data in computational physics: a review
Sibo Cheng, Marc Bocquet, Weiping Ding +20
Unstructured grid data are essential for modelling complex geometries and dynamics in computational physics. Yet, their inherent irregularity presents significant challenges for co…
Fire-Image-DenseNet (FIDN) for predicting wildfire burnt area using remote sensing data
Bo Pang, Sibo Cheng, Yuhan Huang +5
Predicting the extent of massive wildfires once ignited is essential to reduce the subsequent socioeconomic losses and environmental damage, but challenging because of the complexi…
Stacking Your Transformers: A Closer Look at Model Growth for Efficient LLM Pre-Training
Wenyu Du, Tongxu Luo, Zihan Qiu +5
LLMs are computationally expensive to pre-train due to their large scale. Model growth emerges as a promising approach by leveraging smaller models to accelerate the training of la…