activity
20222024
most citedDo Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation

5 citations · 9 across the 5 of their papers we have counts for

collaborators

5 papers

cs.DB2024

AutoCE: An Accurate and Efficient Model Advisor for Learned Cardinality Estimation

Jintao Zhang, Chao Zhang, Guoliang Li +1

Cardinality estimation (CE) plays a crucial role in many database-related tasks such as query generation, cost estimation, and join ordering. Lately, we have witnessed the emergenc…

cs.LG2023★ 3 cited

FedMEKT: Distillation-based Embedding Knowledge Transfer for Multimodal Federated Learning

Huy Q. Le, Minh N. H. Nguyen, Chu Myaet Thwal +3

Federated learning (FL) enables a decentralized machine learning paradigm for multiple clients to collaboratively train a generalized global model without sharing their private dat…

cs.CV2023

A Solution to CVPR'2023 AQTC Challenge: Video Alignment for Multi-Step Inference

Chao Zhang, Shiwei Wu, Sirui Zhao +2

Affordance-centric Question-driven Task Completion (AQTC) for Egocentric Assistant introduces a groundbreaking scenario. In this scenario, through learning instructional videos, AI…

cs.LG2023★ 5 cited

Do Not Blindly Imitate the Teacher: Using Perturbed Loss for Knowledge Distillation

Rongzhi Zhang, Jiaming Shen, Tianqi Liu +4

Knowledge distillation is a popular technique to transfer knowledge from large teacher models to a small student model. Typically, the student learns to imitate the teacher by mini…

cs.DB2022★ 1 cited

A Reachability Index for Recursive Label-Concatenated Graph Queries

Chao Zhang, Angela Bonifati, Hugo Kapp +2

Reachability queries checking the existence of a path from a source node to a target node are fundamental operators for querying and processing graph data. Current approaches for i…