4 papers
Learning Polynomial Activation Functions for Deep Neural Networks
Linghao Zhang, Jiawang Nie, Tingting Tang
Activation functions are crucial for deep neural networks. This novel work frames the problem of training neural network with learnable polynomial activation functions as a polynom…
Lagrange multiplier expressions for matrix polynomial optimization and tight relaxations
Lei Huang, Jiawang Nie, Jiajia Wang +1
This paper studies matrix constrained polynomial optimization. We investigate how to get explicit expressions for Lagrange multiplier matrices from the first order optimality condi…
Optimization over the weakly Pareto set and multi-task learning
Lei Huang, Jiawang Nie, Jiajia Wang
We study the optimization problem over the weakly Pareto set of a convex multiobjective optimization problem given by polynomial functions. Using Lagrange multiplier expressions an…
Sparse Polynomial Optimization with Matrix Constraints
Jiawang Nie, Zheng Qu, Xindong Tang +1
This paper studies the hierarchy of sparse matrix Moment-SOS relaxations for solving sparse polynomial optimization problems with matrix constraints. First, we prove a sufficient a…