activity
20232026
most citedKnowledge Distillation Based on Transformed Teacher Matching

5 citations · 9 across the 15 of their papers we have counts for

collaborators
Showing 2025Show all

5 papers · 1 filter

cs.LG2025

Coupled Data and Measurement Space Dynamics for Enhanced Diffusion Posterior Sampling

Shayan Mohajer Hamidi, En-Hui Yang, Ben Liang

Inverse problems, where the goal is to recover an unknown signal from noisy or incomplete measurements, are central to applications in medical imaging, remote sensing, and computat…

cs.LG2025

Towards Undistillable Models by Minimizing Conditional Mutual Information

Linfeng Ye, Shayan Mohajer Hamidi, En-hui Yang

A deep neural network (DNN) is said to be undistillable if, when used as a black-box input-output teacher, it cannot be distilled through knowledge distillation (KD). In this case,…

cs.CL2025

Leveraging Conditional Mutual Information to Improve Large Language Model Fine-Tuning For Classification

Thanushon Sivakaran, En-Hui Yang

Although large language models (LLMs) have demonstrated remarkable capabilities in recent years, the potential of information theory (IT) to enhance LLM development remains underex…

cs.LG2025

Coded Deep Learning: Framework and Algorithm

En-hui Yang, Shayan Mohajer Hamidi

The success of deep learning (DL) is often achieved with large models and high complexity during both training and post-training inferences, hindering training in resource-limited…

cs.LG2025

Conditional Mutual Information Based Diffusion Posterior Sampling for Solving Inverse Problems

Shayan Mohajer Hamidi, En-Hui Yang

Inverse problems are prevalent across various disciplines in science and engineering. In the field of computer vision, tasks such as inpainting, deblurring, and super-resolution ar…