activity
20212026
most citedTowards Understanding the Condensation of Neural Networks at Initial Training

8 citations · 16 across the 10 of their papers we have counts for

collaborators
Showing cs.LGShow all

7 papers · 1 filter

cs.LG2026

DiffoR: A Unified Continuous Generative Framework for Universal Ordinal Regression

Hongxu Ma, Lin Wang, Chenghou Jin +6

Ordinal Regression (OR) aims to predict target values with inherent order, underpinning critical applications across diverse domains, from recommender systems to computer vision. T…

cs.LG2024

Understanding Time Series Anomaly State Detection through One-Class Classification

Hanxu Zhou, Yuan Zhang, Guangjie Leng +2

For a long time, research on time series anomaly detection has mainly focused on finding outliers within a given time series. Admittedly, this is consistent with some practical pro…

cs.LG2023

Understanding the Initial Condensation of Convolutional Neural Networks

Zhangchen Zhou, Hanxu Zhou, Yuqing Li +1

Previous research has shown that fully-connected networks with small initialization and gradient-based training methods exhibit a phenomenon known as condensation during training.…

cs.LG2022

Combinatorial optimization for low bit-width neural networks

Han Zhou, Aida Ashrafi, Matthew B. Blaschko

Low-bit width neural networks have been extensively explored for deployment on edge devices to reduce computational resources. Existing approaches have focused on gradient-based op…

cs.LG2022★ 2 cited

Empirical Phase Diagram for Three-layer Neural Networks with Infinite Width

Hanxu Zhou, Qixuan Zhou, Zhenyuan Jin +3

Substantial work indicates that the dynamics of neural networks (NNs) is closely related to their initialization of parameters. Inspired by the phase diagram for two-layer ReLU NNs…

cs.LG2021★ 1 cited

Dropout in Training Neural Networks: Flatness of Solution and Noise Structure

Zhongwang Zhang, Hanxu Zhou, Zhi-Qin John Xu

It is important to understand how the popular regularization method dropout helps the neural network training find a good generalization solution. In this work, we show that the tr…

cs.LG2021★ 8 cited

Towards Understanding the Condensation of Neural Networks at Initial Training

Hanxu Zhou, Qixuan Zhou, Tao Luo +2

Empirical works show that for ReLU neural networks (NNs) with small initialization, input weights of hidden neurons (the input weight of a hidden neuron consists of the weight from…