3 papers
cs.LG2024
Mixer is more than just a model
Qingfeng Ji, Yuxin Wang, Letong Sun
Recently, MLP structures have regained popularity, with MLP-Mixer standing out as a prominent example. In the field of computer vision, MLP-Mixer is noted for its ability to extrac…
cs.LG2024
Sample-based Dynamic Hierarchical Transformer with Layer and Head Flexibility via Contextual Bandit
Fanfei Meng, Lele Zhang, Yu Chen +1
Transformer requires a fixed number of layers and heads which makes them inflexible to the complexity of individual samples and expensive in training and inference. To address this…
cs.LG2024
FedEmb: A Vertical and Hybrid Federated Learning Algorithm using Network And Feature Embedding Aggregation
Fanfei Meng, Lele Zhang, Yu Chen +1
Federated learning (FL) is an emerging paradigm for decentralized training of machine learning models on distributed clients, without revealing the data to the central server. The…