87 citations · 634 across the 83 of their papers we have counts for
19 papers · 1 filter
HiTeA: Hierarchical Temporal-Aware Video-Language Pre-training
Qinghao Ye, Guohai Xu, Ming Yan +4
Video-language pre-training has advanced the performance of various downstream video-language tasks. However, most previous methods directly inherit or adapt typical image-language…
SeqDiffuSeq: Text Diffusion with Encoder-Decoder Transformers
Hongyi Yuan, Zheng Yuan, Chuanqi Tan +2
Diffusion model, a new generative modelling paradigm, has achieved great success in image, audio, and video generation. However, considering the discrete categorical nature of text…
Reasoning with Language Model Prompting: A Survey
Shuofei Qiao, Yixin Ou, Ningyu Zhang +6
Reasoning, as an essential ability for complex problem-solving, can provide back-end support for various real-world applications, such as medical diagnosis, negotiation, etc. This…
HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation
Hongyi Yuan, Zheng Yuan, Chuanqi Tan +2
Language models with the Transformers structure have shown great performance in natural language processing. However, there still poses problems when fine-tuning pre-trained langua…
Primordial Black Holes Place the Universe in Stasis
Keith R. Dienes, Lucien Heurtier, Fei Huang +3
A variety of scenarios for early-universe cosmology give rise to a population of primordial black holes (PBHs) with a broad spectrum of masses. The evaporation of PBHs in such scen…
Dial2vec: Self-Guided Contrastive Learning of Unsupervised Dialogue Embeddings
Che Liu, Rui Wang, Junfeng Jiang +2
In this paper, we introduce the task of learning unsupervised dialogue embeddings. Trivial approaches such as combining pre-trained word or sentence embeddings and encoding through…
Forging Multiple Training Objectives for Pre-trained Language Models via Meta-Learning
Hongqiu Wu, Ruixue Ding, Hai Zhao +4
Multiple pre-training objectives fill the vacancy of the understanding capability of single-objective language modeling, which serves the ultimate purpose of pre-trained language m…
Rainbow vertex pair-pancyclicity of strongly edge-colored graphs
Peixue Zhao, Fei Huang
An edge-colored graph is \emph{rainbow }if no two edges of the graph have the same color. An edge-colored graph is called \emph{properly colored} if every two adjacent edges…
Electroweak precision tests for triplet scalars
Yu Cheng, Xiao-Gang He, Fei Huang +2
Electroweak precision observables are fundamentally important for testing the standard model (SM) or its extensions. The influences to observables from new physics within the elect…
MuCGEC: a Multi-Reference Multi-Source Evaluation Dataset for Chinese Grammatical Error Correction
Yue Zhang, Zhenghua Li, Zuyi Bao +5
This paper presents MuCGEC, a multi-reference multi-source evaluation dataset for Chinese Grammatical Error Correction (CGEC), consisting of 7,063 sentences collected from three Ch…
Nucleon and resonances in photoproduction
Neng-Chang Wei, Ai-Chao Wang, Fei Huang +1
The most recent data on beam asymmetries, , and beam-target asymmetries, , from the CLAS Collaboration, together with the previous data on differential cross sections and bea…
Image Captioning In the Transformer Age
Yang Xu, Li Li, Haiyang Xu +3
Image Captioning (IC) has achieved astonishing developments by incorporating various techniques into the CNN-RNN encoder-decoder architecture. However, since CNN and RNN do not sha…
Probing Structured Pruning on Multilingual Pre-trained Models: Settings, Algorithms, and Efficiency
Yanyang Li, Fuli Luo, Runxin Xu +3
Structured pruning has been extensively studied on monolingual pre-trained language models and is yet to be fully evaluated on their multilingual counterparts. This work investigat…
Dark photon kinetic mixing effects for the CDF W-mass measurement
Yu Cheng, Xiao-Gang He, Fei Huang +2
A new gauge boson primarily interacting with a dark sector can have renormalizable kinetic mixing with the standard model (SM) gauge boson . This mixing be…
Knowledgeable Salient Span Mask for Enhancing Language Models as Knowledge Base
Cunxiang Wang, Fuli Luo, Yanyang Li +3
Pre-trained language models (PLMs) like BERT have made significant progress in various downstream NLP tasks. However, by asking models to do cloze-style tests, recent work finds th…
Contrastive Demonstration Tuning for Pre-trained Language Models
Xiaozhuan Liang, Ningyu Zhang, Siyuan Cheng +3
Pretrained language models can be effectively stimulated by textual prompts or demonstrations, especially in low-data scenarios. Recent works have focused on automatically searchin…
Using 5G in Smart Cities: A Systematic Mapping Study
Chen Yang, Peng Liang, Liming Fu +4
5G is the fifth generation wireless network, with a set of characteristics, e.g., high bandwidth and data rates. The scenarios of using 5G include enhanced Mobile Broadband (eMBB),…
Reasoning Through Memorization: Nearest Neighbor Knowledge Graph Embeddings
Peng Wang, Xin Xie, Xiaohan Wang +1
Previous knowledge graph embedding approaches usually map entities to representations and utilize score functions to predict the target entities, yet they typically struggle to rea…
DeepKE: A Deep Learning Based Knowledge Extraction Toolkit for Knowledge Base Population
Ningyu Zhang, Xin Xu, Liankuan Tao +19
We present an open-source and extensible knowledge extraction toolkit DeepKE, supporting complicated low-resource, document-level and multimodal scenarios in the knowledge base pop…