activity
20242026
most citedCatastrophic Failure of LLM Unlearning via Quantization

2 citations · 5 across the 33 of their papers we have counts for

collaborators
Showing 2024Show all

6 papers · 1 filter

cs.AI2024

A Survey of Calibration Process for Black-Box LLMs

Liangru Xie, Hui Liu, Jingying Zeng +7

Large Language Models (LLMs) demonstrate remarkable performance in semantic understanding and generation, yet accurately assessing their output reliability remains a significant ch…

cs.AI2024

Learning with Less: Knowledge Distillation from Large Language Models via Unlabeled Data

Juanhui Li, Sreyashi Nag, Hui Liu +7

In real-world NLP applications, Large Language Models (LLMs) offer promising solutions due to their extensive training on vast datasets. However, the large size and high computatio…

cs.CL2024★ 1 cited

SimRAG: Self-Improving Retrieval-Augmented Generation for Adapting Large Language Models to Specialized Domains

Ran Xu, Hui Liu, Sreyashi Nag +8

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-pur…

cs.CL2024★ 2 cited

Catastrophic Failure of LLM Unlearning via Quantization

Zhiwei Zhang, Fali Wang, Xiaomin Li +6

Large language models (LLMs) have shown remarkable proficiency in generating text, benefiting from extensive training on vast textual corpora. However, LLMs may also acquire unwant…

cs.AI2024

Divide-Verify-Refine: Can LLMs Self-Align with Complex Instructions?

Xianren Zhang, Xianfeng Tang, Hui Liu +4

Recent studies show LLMs struggle with complex instructions involving multiple constraints (e.g., length, format, sentiment). Existing works address this issue by fine-tuning, whic…

cs.CL2024

Code-Based English Models Surprising Performance on Chinese QA Pair Extraction Task

Linghan Zheng, Hui Liu, Xiaojun Lin +5

In previous studies, code-based models have consistently outperformed text-based models in reasoning-intensive scenarios. When generating our knowledge base for Retrieval-Augmented…