Showing cs.LGShow all
2 papers · 1 filter
cs.LG2024
The Nature of Mathematical Modeling and Probabilistic Optimization Engineering in Generative AI
Fulu Li
In this paper, we give an in-depth analysis on the mathematical problem formulations and the probabilistic optimization explorations for some of the key components in Transformer m…
cs.LG2024
Cross-Entropy Optimization for Hyperparameter Optimization in Stochastic Gradient-based Approaches to Train Deep Neural Networks
Kevin Li, Fulu Li
In this paper, we present a cross-entropy optimization method for hyperparameter optimization in stochastic gradient-based approaches to train deep neural networks. The value of a…