3 citations · 3 across the 7 of their papers we have counts for
9 papers
Cache Locally, Recompute Selectively for Streaming Video Understanding
Junhyeok Lee, Sangyoon Lee, Jaeho Lee
Streaming video understanding (SVU) requires video-LLMs to process incoming video continuously while answering user queries with low latency. Recent methods reduce query-time cost…
ixi-sLM: On-Device sLM for AI Call Agent Service
Han-Sang Lee, Kyuho Lee, Juneyoung Park +10
Running an AI call agent on-device makes it private, network-independent, and free of per-query cloud cost, but shipping one as a real-world service imposes constraints a cloud dep…
FoRA: Fisher-orthogonal Rank Adaptation for Parameter-Efficient Fine-Tuning
Juneyoung Park, Seongbae Lee, Han-Sang Lee +6
Parameter-efficient fine-tuning(PEFT) has largely focused on LoRA and its accuracy-oriented variants, leaving the original goal of reducing trainable parameters has receivedcompara…
Decoder-Free Distillation for Quantized Image Restoration
S. M. A. Sharif, Abdur Rehman, Seongwan Kim +1
Quantization-Aware Training (QAT), combined with Knowledge Distillation (KD), holds immense promise for compressing models for edge deployment. However, joint optimization for prec…
LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
Juneyoung Park, Eunbeen Yoon, Seongwan Kim. Jaeho Lee
Memory-efficient backpropagation (MeBP) has enabled first-order fine-tuning of large language models (LLMs) on mobile devices with less than 1GB memory. However, MeBP requires back…
Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
Juneyoung Park, Yuri Hong, Seongwan Kim +1
On-device fine-tuning enables privacy-preserving personalization of large language models, but mobile devices impose severe memory constraints, typically 6--12GB shared across all…
Punching Above Precision: Small Quantized Model Distillation with Learnable Regularizer
Abdur Rehman, S M A Sharif, Md Abdur Rahaman +3
Quantization-aware training (QAT) combined with knowledge distillation (KD) is a promising strategy for compressing Artificial Intelligence (AI) models for deployment on resource-c…
Riemannian Optimization for LoRA on the Stiefel Manifold
Juneyoung Park, Minjae Kang, Seongbae Lee +3
While powerful, large language models (LLMs) present significant fine-tuning challenges due to their size. Parameter-efficient fine-tuning (PEFT) methods like LoRA provide solution…
NTIRE 2024 Challenge on Low Light Image Enhancement: Methods and Results
Xiaoning Liu, Zongwei Wu, Ao Li +109
This paper reviews the NTIRE 2024 low light image enhancement challenge, highlighting the proposed solutions and results. The aim of this challenge is to discover an effective netw…