Showing cs.LGShow all
2 papers · 1 filter
cs.LG2025
Self Distillation Fine-Tuning of Protein Language Models Improves Versatility in Protein Design
Amin Tavakoli, Raswanth Murugan, Ozan Gokdemir +3
Supervised fine-tuning (SFT) is a standard approach for adapting large language models to specialized domains, yet its application to protein sequence modeling and protein language…
cs.LG2024
LSHBloom: Memory-efficient, Extreme-scale Document Deduplication
Arham Khan, Robert Underwood, Carlo Siebenschuh +7
Contemporary large language model (LLM) training pipelines require the assembly of internet-scale databases full of text data from a variety of sources (e.g., web, academic, and pu…