Advancing Model Refinement: Muon-Optimized Distillation and Quantization for LLM Deployment

Jacob Sander, Brian Jalaian, Venkat R. Dasari

Large Language Models (LLMs) enable advanced natural language processing but face deployment challenges on resource-constrained edge devices due to high computational, memory, and…