3 citations · 3 across the 7 of their papers we have counts for
4 papers · 1 filter
Asymmetric Capacity Allocation in Self-Refinement Pipelines
Zhuoyi Yang, Ian G. Harris, Salar Hashemitaheri +7
Self-refinement, typically structured as generation, critique, and revision, is a widely adopted paradigm for improving LLM generation and serves as a core mechanism in many LLM ag…
AMAQ: Adaptive Mixed-bit Activation Quantization for Collaborative Parameter Efficient Fine-tuning
Yurun Song, Zhuoyi Yang, Ian G. Harris +1
Large Language Models (LLMs) are scaling rapidly, creating significant challenges for collaborative server client distributed training, particularly in terms of communication effic…
CoopQ: Cooperative Game Inspired Layerwise Mixed Precision Quantization for LLMs
Junchen Zhao, Ali Derakhshan, Jayden Kana Hyman +3
Large Language Models (LLMs) promise impressive capabilities, yet their multi-billion-parameter scale makes on-device or low-resource deployment prohibitive. Mixed-precision quanti…
LinguaLinked: A Distributed Large Language Model Inference System for Mobile Devices
Junchen Zhao, Yurun Song, Simeng Liu +2
Deploying Large Language Models (LLMs) locally on mobile devices presents a significant challenge due to their extensive memory requirements. In this paper, we introduce LinguaLink…