Maestro: Uncovering Low-Rank Structures via Trainable Decomposition

Samuel Horvath, Stefanos Laskaridis, Shashank Rajput +1

Deep Neural Networks (DNNs) have been a large driver for AI breakthroughs in recent years. However, these models have been getting increasingly large as they become more accurate a…