3 papers
cs.LG2025
CoopQ: Cooperative Game Inspired Layerwise Mixed Precision Quantization for LLMs
Junchen Zhao, Ali Derakhshan, Jayden Kana Hyman +3
Large Language Models (LLMs) promise impressive capabilities, yet their multi-billion-parameter scale makes on-device or low-resource deployment prohibitive. Mixed-precision quanti…
cs.CL2024
ShareLoRA: Parameter Efficient and Robust Large Language Model Fine-tuning via Shared Low-Rank Adaptation
Yurun Song, Junchen Zhao, Ian G. Harris +1
In this paper, we introduce \textbf{Share}d \textbf{Lo}w \textbf{R}ank \textbf{A}daptation (ShareLoRA), a Large Language Model (LLM) fine-tuning technique that balances parameter e…
cs.LG2023
LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices
Junchen Zhao, Yurun Song, Simeng Liu +2
Deploying Large Language Models (LLMs) locally on mobile devices presents a significant challenge due to their extensive memory requirements. In this paper, we introduce LinguaLink…