24 citations · 28 across the 14 of their papers we have counts for
3 papers · 1 filter
Compressed Concatenation of Small Embedding Models
Mohamed Ayoub Ben Ayad, Michael Dinzinger, Kanishka Ghosh Dastidar +2
Embedding models are central to dense retrieval, semantic search, and recommendation systems, but their size often makes them impractical to deploy in resource-constrained environm…
Krony-PT: GPT2 compressed with Kronecker Products
Mohamed Ayoub Ben Ayad, Jelena Mitrovic, Michael Granitzer
We introduce Krony-PT, a compression technique for GPT-2 based on Kronecker products. We specifically target the feed-forward weights of each transformer block, and systematically…
SUDS: A Strategy for Unsupervised Drift Sampling
Christofer Fellicious, Lorenz Wendlinger, Mario Gancarski +2
Supervised machine learning often encounters concept drift, where the data distribution changes over time, degrading model performance. Existing drift detection methods focus on id…