activity
20102023
most citedDomain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey

74 citations · 272 across the 31 of their papers we have counts for

collaborators

31 papers

cs.LG2023★ 6 cited

Skill Disentanglement for Imitation Learning from Suboptimal Demonstrations

Tianxiang Zhao, Wenchao Yu, Suhang Wang +6

Imitation learning has achieved great success in many sequential decision-making tasks, in which a neural agent is learned by imitating collected human demonstrations. However, exi…

cs.CL2023

Uncertainty-Aware Bootstrap Learning for Joint Extraction on Distantly-Supervised Data

Yufei Li, Xiao Yu, Yanchi Liu +2

Jointly extracting entity pairs and their relations is challenging when working on distantly-supervised data with ambiguous or noisy labels. To mitigate such impact, we propose unc…

cs.LG2023

Disentangled Causal Graph Learning for Online Unsupervised Root Cause Analysis

Dongjie Wang, Zhengzhang Chen, Yanjie Fu +2

The task of root cause analysis (RCA) is to identify the root causes of system faults/failures by analyzing system monitoring data. Efficient RCA can greatly accelerate system fail…

cs.IR2023★ 4 cited

Frequency Enhanced Hybrid Attention Network for Sequential Recommendation

Xinyu Du, Huanhuan Yuan, Pengpeng Zhao +4

The self-attention mechanism, which equips with a strong capability of modeling long-range dependencies, is one of the extensively used techniques in the sequential recommendation…

cs.IR2023★ 1 cited

Ensemble Modeling with Contrastive Knowledge Distillation for Sequential Recommendation

Hanwen Du, Huanhuan Yuan, Pengpeng Zhao +4

Sequential recommendation aims to capture users' dynamic interest and predicts the next item of users' preference. Most sequential recommendation methods use a deep neural network…

cs.AI2023★ 1 cited

Sequential Recommendation with Probabilistic Logical Reasoning

Huanhuan Yuan, Pengpeng Zhao, Xuefeng Xian +3

Deep learning and symbolic learning are two frequently employed methods in Sequential Recommendation (SR). Recent neural-symbolic SR models demonstrate their potential to enable SR…

cs.IR2023

Contrastive Enhanced Slide Filter Mixer for Sequential Recommendation

Xinyu Du, Huanhuan Yuan, Pengpeng Zhao +5

Sequential recommendation (SR) aims to model user preferences by capturing behavior patterns from their item historical interaction data. Most existing methods model user preferenc…

cs.CL2023★ 74 cited

Domain Specialization as the Key to Make Large Language Models Disruptive: A Comprehensive Survey

Chen Ling, Xujiang Zhao, Jiaying Lu +21

Large language models (LLMs) have significantly advanced the field of natural language processing (NLP), providing a highly useful, task-agnostic foundation for a wide range of app…

cs.LG2023★ 6 cited

Personalized Federated Learning under Mixture of Distributions

Yue Wu, Shuaicheng Zhang, Wenchao Yu +5

The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while mai…

cs.IR2023★ 57 cited

Meta-optimized Contrastive Learning for Sequential Recommendation

Xiuyuan Qin, Huanhuan Yuan, Pengpeng Zhao +4

Contrastive Learning (CL) performances as a rising approach to address the challenge of sparse and noisy recommendation data. Although having achieved promising results, most exist…

cs.LG2023★ 1 cited

Time Series Contrastive Learning with Information-Aware Augmentations

Dongsheng Luo, Wei Cheng, Yingheng Wang +8

Various contrastive learning approaches have been proposed in recent years and achieve significant empirical success. While effective and prevalent, contrastive learning has been l…

cs.IR2022★ 1 cited

Contrastive Learning with Bidirectional Transformers for Sequential Recommendation

Hanwen Du, Hui Shi, Pengpeng Zhao +5

Contrastive learning with Transformer-based sequence encoder has gained predominance for sequential recommendation. It maximizes the agreements between paired sequence augmentation…

cs.IR2022

Learnable Model Augmentation Self-Supervised Learning for Sequential Recommendation

Yongjing Hao, Pengpeng Zhao, Xuefeng Xian +5

Sequential Recommendation aims to predict the next item based on user behaviour. Recently, Self-Supervised Learning (SSL) has been proposed to improve recommendation performance. H…

cs.LG2021

Exploiting Bi-directional Global Transition Patterns and Personal Preferences for Missing POI Category Identification

Dongbo Xi, Fuzhen Zhuang, Yanchi Liu +4

Recent years have witnessed the increasing popularity of Location-based Social Network (LBSN) services, which provides unparalleled opportunities to build personalized Point-of-Int…

cs.LG2021★ 13 cited

Modelling of Bi-directional Spatio-Temporal Dependence and Users' Dynamic Preferences for Missing POI Check-in Identification

Dongbo Xi, Fuzhen Zhuang, Yanchi Liu +3

Human mobility data accumulated from Point-of-Interest (POI) check-ins provides great opportunity for user behavior understanding. However, data quality issues (e.g., geolocation i…

cs.CL2021

Do Multi-Lingual Pre-trained Language Models Reveal Consistent Token Attributions in Different Languages?

Junxiang Wang, Xuchao Zhang, Bo Zong +5

During the past several years, a surge of multi-lingual Pre-trained Language Models (PLMs) has been proposed to achieve state-of-the-art performance in many cross-lingual downstrea…

cs.CR2021★ 1 cited

Cyberphysical Sequencing for Distributed Asset Management with Broad Traceability

Joshua Siegel, Gregory Falco

Cyber-Physical systems (CPS) have complex lifecycles involving multiple stakeholders, and the transparency of both hardware and software components' supply chain is opaque at best.…

cs.CL2021★ 2 cited

Zero-Shot Cross-Lingual Machine Reading Comprehension via Inter-sentence Dependency Graph

Liyan Xu, Xuchao Zhang, Bo Zong +6

We target the task of cross-lingual Machine Reading Comprehension (MRC) in the direct zero-shot setting, by incorporating syntactic features from Universal Dependencies (UD), and t…

cs.IR2021★ 3 cited

Edge-Enhanced Global Disentangled Graph Neural Network for Sequential Recommendation

Yunyi Li, Pengpeng Zhao, Guanfeng Liu +4

Sequential recommendation has been a widely popular topic of recommender systems. Existing works have contributed to enhancing the prediction ability of sequential recommendation s…

cs.IR2021

Quaternion-Based Graph Convolution Network for Recommendation

Yaxing Fang, Pengpeng Zhao, Guanfeng Liu +4

Graph Convolution Network (GCN) has been widely applied in recommender systems for its representation learning capability on user and item embeddings. However, GCN is vulnerable to…

cs.CL2021★ 3 cited

Unsupervised Document Embedding via Contrastive Augmentation

Dongsheng Luo, Wei Cheng, Jingchao Ni +8

We present a contrasting learning approach with data augmentation techniques to learn document representations in an unsupervised manner. Inspired by recent contrastive self-superv…

cs.LG2021

Dynamic Gaussian Mixture based Deep Generative Model For Robust Forecasting on Sparse Multivariate Time Series

Yinjun Wu, Jingchao Ni, Wei Cheng +7

Forecasting on sparse multivariate time series (MTS) aims to model the predictors of future values of time series given their incomplete past, which is important for many emerging…

cs.LG2020★ 1 cited

T-Net: A Semi-supervised Deep Model for Turbulence Forecasting

Denghui Zhang, Yanchi Liu, Wei Cheng +5

Accurate air turbulence forecasting can help airlines avoid hazardous turbulence, guide the routes that keep passengers safe, maximize efficiency, and reduce costs. Traditional tur…

cs.AI2020★ 9 cited

Job2Vec: Job Title Benchmarking with Collective Multi-View Representation Learning

Denghui Zhang, Junming Liu, Hengshu Zhu +4

Job Title Benchmarking (JTB) aims at matching job titles with similar expertise levels across various companies. JTB could provide precise guidance and considerable convenience for…