2 papers
cs.LG2025
Compressed Concatenation of Small Embedding Models
Mohamed Ayoub Ben Ayad, Michael Dinzinger, Kanishka Ghosh Dastidar +2
Embedding models are central to dense retrieval, semantic search, and recommendation systems, but their size often makes them impractical to deploy in resource-constrained environm…
cs.LG2024
Krony-PT: GPT2 compressed with Kronecker Products
Mohamed Ayoub Ben Ayad, Jelena Mitrovic, Michael Granitzer
We introduce Krony-PT, a compression technique for GPT-2 based on Kronecker products. We specifically target the feed-forward weights of each transformer block, and systematically…