Projected Compression: Trainable Projection for Efficient Transformer Compression

Maciej Stefaniak, Michał Krutul, Jan Małaśnicki +6

Large language models have steadily increased in size to achieve improved performance; however, this growth has also led to greater inference time and computational demands. Conseq…