activity
20222024
most citedStreamlining Redundant Layers to Compress Large Language Models

3 citations · 7 across the 7 of their papers we have counts for

collaborators

7 papers

cs.AI2024

P Law: Scaling Law for Post-Training After Model Pruning

Xiaodong Chen, Yuxuan Hu, Xiaokang Zhang +4

Pruning has become a widely adopted technique for reducing the hardware requirements of large language models (LLMs). To recover model performance after pruning, post-training is c…

cs.CL2024

A Learn-Then-Reason Model Towards Generalization in Knowledge Base Question Answering

Lingxi Zhang, Jing Zhang, Yanling Wang +2

Large-scale knowledge bases (KBs) like Freebase and Wikidata house millions of structured knowledge. Knowledge Base Question Answering (KBQA) provides a user-friendly way to access…

cs.CL2024

SGSH: Stimulate Large Language Models with Skeleton Heuristics for Knowledge Base Question Generation

Shasha Guo, Lizi Liao, Jing Zhang +3

Knowledge base question generation (KBQG) aims to generate natural language questions from a set of triplet facts extracted from KB. Existing methods have significantly boosted the…

cs.LG2024

Open-World Semi-Supervised Learning for Node Classification

Yanling Wang, Jing Zhang, Lingxi Zhang +5

Open-world semi-supervised learning (Open-world SSL) for node classification, that classifies unlabeled nodes into seen classes or multiple novel classes, is a practical but under-…

cs.CL2024★ 3 cited

Streamlining Redundant Layers to Compress Large Language Models

Xiaodong Chen, Yuxuan Hu, Jing Zhang +3

This paper introduces LLM-Streamline, a pioneer work on layer pruning for large language models (LLMs). It is based on the observation that different layers have varying impacts on…

cs.AI2023★ 2 cited

FC-KBQA: A Fine-to-Coarse Composition Framework for Knowledge Base Question Answering

Lingxi Zhang, Jing Zhang, Yanling Wang +5

The generalization problem on KBQA has drawn considerable attention. Existing research suffers from the generalization issue brought by the entanglement in the coarse-grained model…

cs.IR2022★ 2 cited

Continual Transfer Learning for Cross-Domain Click-Through Rate Prediction at Taobao

Lixin Liu, Yanling Wang, Tianming Wang +6

As one of the largest e-commerce platforms in the world, Taobao's recommendation systems (RSs) serve the demands of shopping for hundreds of millions of customers. Click-Through Ra…