activity
20192026
most citedKnowledge Distillation from Internal Representations

23 citations · 26 across the 4 of their papers we have counts for

collaborators
Showing cs.CLShow all

5 papers · 1 filter

cs.CL2026

PA3: Policy-Aware Agent Alignment through Chain-of-Thought

Shubhashis Roy Dipta, Daniel Bis, Kun Zhou +4

Conversational assistants powered by large language models (LLMs) excel at tool-use tasks but struggle with adhering to complex, business-specific rules. While models can reason ov…

cs.CL2026

Beyond Perfect APIs: A Comprehensive Evaluation of LLM Agents Under Real-World API Complexity

Doyoung Kim, Zhiwei Ren, Jie Hao +11

We introduce WildAGTEval, a benchmark designed to evaluate large language model (LLM) agents' function-calling capabilities under realistic API complexity. Unlike prior work that a…

cs.CL2023

PersonaPKT: Building Personalized Dialogue Agents via Parameter-efficient Knowledge Transfer

Xu Han, Bin Guo, Yoon Jung +4

Personalized dialogue agents (DAs) powered by large pre-trained language models (PLMs) often rely on explicit persona descriptions to maintain personality consistency. However, suc…

cs.CL2023

KEPLET: Knowledge-Enhanced Pretrained Language Model with Topic Entity Awareness

Yichuan Li, Jialong Han, Kyumin Lee +3

In recent years, Pre-trained Language Models (PLMs) have shown their superiority by pre-training on unstructured text corpus and then fine-tuning on downstream tasks. On entity-ric…

cs.CL201923 cited

Knowledge Distillation from Internal Representations

Gustavo Aguilar, Yuan Ling, Yu Zhang +3

Knowledge distillation is typically conducted by training a small model (the student) to mimic a large and cumbersome model (the teacher). The idea is to compress the knowledge fro…