Differentiable Efficient Operator Search

Xiaohuan Pei, Jiyuan Zhang, Yuanfan Guo +4

Efficient multimodal foundation models often rely on manually designed token-reduction operators, such as pruning, merging, pooling, and adaptive reweighting. Although these operat…