3 citations · 3 across the 5 of their papers we have counts for
Showing 2024Show all
3 papers · 1 filter
cs.LG2024★ 3 cited
EvoLlama: Enhancing LLMs' Understanding of Proteins via Multimodal Structure and Sequence Representations
Nuowei Liu, Changzhi Sun, Tao Ji +4
Current Large Language Models (LLMs) for understanding proteins primarily treats amino acid sequences as a text modality. Meanwhile, Protein Language Models (PLMs), such as ESM-2,…
cs.CL2024
Untie the Knots: An Efficient Data Augmentation Strategy for Long-Context Pre-Training in Language Models
Junfeng Tian, Da Zheng, Yang Cheng +3
Large language models (LLM) have prioritized expanding the context window from which models can incorporate more information. However, training models to handle long contexts prese…
cs.CL2024
Nyonic Technical Report
Junfeng Tian, Rui Wang, Cong Li +3
This report details the development and key achievements of our latest language model designed for custom large language models. The advancements introduced include a novel Online…