23 citations · 52 across the 21 of their papers we have counts for
4 papers · 1 filter
Constitutional On-Policy Safe Distillation
Ming Wen, Yuxuan Liu, Kun Yang +8
On-policy self-distillation (OPSD) has emerged as an efficient post-training paradigm by using a teacher conditioned on privileged information to provide dense token-level supervis…
AutoAC: Towards Automated Attribute Completion for Heterogeneous Graph Neural Network
Guanghui Zhu, Zhennan Zhu, Wenjie Wang +3
Many real-world data can be modeled as heterogeneous graphs that contain multiple types of nodes and edges. Meanwhile, due to excellent performance, heterogeneous graph neural netw…
MT-GBM: A Multi-Task Gradient Boosting Machine with Shared Decision Trees
ZhenZhe Ying, Zhuoer Xu, Zhifeng Li +2
Despite the success of deep learning in computer vision and natural language processing, Gradient Boosted Decision Tree (GBDT) is yet one of the most powerful tools for application…
DIFER: Differentiable Automated Feature Engineering
Guanghui Zhu, Zhuoer Xu, Xu Guo +2
Feature engineering, a crucial step of machine learning, aims to extract useful features from raw data to improve data quality. In recent years, great efforts have been devoted to…