Training Foundation Models as Data Compression: On Information, Model Weights and Copyright Law

Giorgio Franceschelli, Claudia Cevenini, Mirco Musolesi

The training process of foundation models as for other classes of deep learning systems is based on minimizing the reconstruction error over a training set. For this reason, they a…