128 citations · 128 across the 2 of their papers we have counts for
2 papers
cs.LG2026
ReMix: Reinforcement routing for mixtures of LoRAs in LLM finetuning
Ruizhong Qiu, Hanqing Zeng, Yinglong Xia +15
Low-rank adapters (LoRAs) are a parameter-efficient finetuning technique that injects trainable low-rank matrices into pretrained models to adapt them to new tasks. Mixture-of-LoRA…
cs.LG2020★ 128 cited
Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression
Yiwen Meng, William Speier, Michael K. Ong +1
Advancements in machine learning algorithms have had a beneficial impact on representation learning, classification, and prediction models built using electronic health record (EHR…