Showing cs.LGShow all
2 papers · 1 filter
cs.LG2026
Fast Tensorization of Neural Networks via Slice-wise Feature Distillation
Safa Hamreras, Sukhbinder Singh, Román Orús
We propose a scalable tensorization framework for neural network compression based on slice-wise feature distillation. Unlike conventional tensor decomposition methods that rely on…
cs.LG2026
Weight Clustering Reveals the Importance of Relative Rank in Large Language Models
Borja Aizpurua, Sukhbinder Singh, Román Orús
Large language models (LLMs) contain billions of parameters, but many exact weight values are not essential. We apply scalar -means clustering to pretrained models, replacing ea…