most citedX-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Design

1 citations · 1 across the 2 of their papers we have counts for

collaborators
Showing cond-mat.softShow all

1 paper · 1 filter

cond-mat.soft2024★ 1 cited

X-LoRA: Mixture of Low-Rank Adapter Experts, a Flexible Framework for Large Language Models with Applications in Protein Mechanics and Molecular Design

Eric L. Buehler, Markus J. Buehler

We report a mixture of expert strategy to create fine-tuned large language models using a deep layer-wise token-level approach based on low-rank adaptation (LoRA). Starting with a…