3 citations · 7 across the 12 of their papers we have counts for
13 papers
Faster MoE LLM Inference for Extremely Large Models
Haoqi Yang, Luohe Shi, Qiwei Li +5
Sparse Mixture of Experts (MoE) large language models (LLMs) are gradually becoming the mainstream approach for ultra-large-scale models. Existing optimization efforts for MoE mode…
A Novel Energy based Model Mechanism for Multi-modal Aspect-Based Sentiment Analysis
Tianshuo Peng, Zuchao Li, Ping Wang +2
Multi-modal aspect-based sentiment analysis (MABSA) has recently attracted increasing attention. The span-based extraction methods, such as FSUIE, demonstrate strong performance in…
ArcMMLU: A Library and Information Science Benchmark for Large Language Models
Shitou Zhang, Zuchao Li, Xingshen Liu +2
In light of the rapidly evolving capabilities of large language models (LLMs), it becomes imperative to develop rigorous domain-specific evaluation benchmarks to accurately assess…
Centroid-centered Modeling for Efficient Vision Transformer Pre-training
Xin Yan, Zuchao Li, Lefei Zhang
Masked Image Modeling (MIM) is a new self-supervised vision pre-training paradigm using a Vision Transformer (ViT). Previous works can be pixel-based or token-based, using original…
Solution of DeBERTaV3 on CommonsenseQA
Letian Peng, Zuchao Li, Hai Zhao
We report the performance of DeBERTaV3 on CommonsenseQA in this report. We simply formalize the answer selection as a text classification for DeBERTaV3. The strong natural language…
Semantics-Preserved Distortion for Personal Privacy Protection in Information Management
Jiajia Li, Lu Yang, Letian Peng +4
In recent years, machine learning - particularly deep learning - has significantly impacted the field of information management. While several strategies have been proposed to rest…
Seeking Common but Distinguishing Difference, A Joint Aspect-based Sentiment Analysis Model
Hongjiang Jing, Zuchao Li, Hai Zhao +1
Aspect-based sentiment analysis (ABSA) task consists of three typical subtasks: aspect term extraction, opinion term extraction, and sentiment polarity classification. These three…
Unsupervised Full Constituency Parsing with Neighboring Distribution Divergence
Letian Peng, Zuchao Li, Hai Zhao
Unsupervised constituency parsing has been explored much but is still far from being solved. Conventional unsupervised constituency parser is only able to capture the unlabeled str…
Sparse Fuzzy Attention for Structured Sentiment Analysis
Letian Peng, Zuchao Li, Hai Zhao
Attention scorers have achieved success in parsing tasks like semantic and syntactic dependency parsing. However, in tasks modeled into parsing, like structured sentiment analysis,…
Cross-lingual Transferring of Pre-trained Contextualized Language Models
Zuchao Li, Kevin Parnow, Hai Zhao +4
Though the pre-trained contextualized language model (PrLM) has made a significant impact on NLP, training PrLMs in languages other than English can be impractical for two reasons:…
Grammatical Error Correction as GAN-like Sequence Labeling
Kevin Parnow, Zuchao Li, Hai Zhao
In Grammatical Error Correction (GEC), sequence labeling models enjoy fast inference compared to sequence-to-sequence models; however, inference in sequence labeling GEC models is…
Head-driven Phrase Structure Parsing in O() Time Complexity
Zuchao Li, Junru Zhou, Hai Zhao +1
Constituent and dependency parsing, the two classic forms of syntactic parsing, have been found to benefit from joint training and decoding under a uniform formalism, Head-driven P…
Neural Unsupervised Semantic Role Labeling
Kashif Munir, Hai Zhao, Zuchao Li
The task of semantic role labeling (SRL) is dedicated to finding the predicate-argument structure. Previous works on SRL are mostly supervised and do not consider the difficulty in…