4 citations · 6 across the 8 of their papers we have counts for
4 papers · 1 filter
Long Exposure: Accelerating Parameter-Efficient Fine-Tuning for LLMs under Shadowy Sparsity
Tuowei Wang, Kun Li, Zixu Hao +5
The adaptation of pre-trained large language models (LLMs) to diverse downstream tasks via fine-tuning is critical for numerous applications. However, the inefficiency of parameter…
SwarmThinkers: Learning Physically Consistent Atomic KMC Transitions at Scale
Qi Li, Kun Li, Haozhi Han +6
Can a scientific simulation system be physically consistent, interpretable by design, and scalable across regimes--all at once? Despite decades of progress, this trifecta remains e…
SparStencil: Retargeting Sparse Tensor Cores to Scientific Stencil Computations via Structured Sparsity Transformation
Qi Li, Kun Li, Haozhi Han +7
Sparse Tensor Cores offer exceptional performance gains for AI workloads by exploiting structured 2:4 sparsity. However, their potential remains untapped for core scientific worklo…
LeMo: Enabling LEss Token Involvement for MOre Context Fine-tuning
Tuowei Wang, Xingyu Chen, Kun Li +3
The escalating demand for long-context applications has intensified the necessity of extending the LLM context windows. Despite recent fine-tuning approaches successfully expanding…