132 citations · 197 across the 17 of their papers we have counts for
3 papers · 1 filter
Reconsidering LLM Uncertainty Estimation Methods in the Wild
Yavuz Bakman, Duygu Nur Yaldiz, Sungmin Kang +4
Large Language Model (LLM) Uncertainty Estimation (UE) methods have become a crucial tool for detecting hallucinations in recent years. While numerous UE methods have been proposed…
Enabling Weak Client Participation via On-device Knowledge Distillation in Heterogeneous Federated Learning
Jihyun Lim, Junhyuk Jo, Tuo Zhang +1
Online Knowledge Distillation (KD) is recently highlighted to train large models in Federated Learning (FL) environments. Many existing studies adopt the logit ensemble method to p…
Leveraging Uncertainty Estimation for Efficient LLM Routing
Tuo Zhang, Asal Mehradfar, Dimitrios Dimitriadis +1
Deploying large language models (LLMs) in edge-cloud environments requires an efficient routing strategy to balance cost and response quality. Traditional approaches prioritize eit…