5 papers
Transformers in Protein: A Survey
Xiaowen Ling, Zhiqiang Li, Yanbin Wang +1
As protein informatics advances rapidly, the demand for enhanced predictive accuracy, structural analysis, and functional understanding has intensified. Transformer models, as powe…
Continuous Multi-Task Pre-training for Malicious URL Detection and Webpage Classification
Yujie Li, Yiwei Liu, Peiyue Li +2
Malicious URL detection and webpage classification are critical tasks in cybersecurity and information management. In recent years, extensive research has explored using BERT or si…
Vul-LMGNNs: Fusing language models and online-distilled graph neural networks for code vulnerability detection
Ruitong Liu, Yanbin Wang, Haitao Xu +4
Code Language Models (codeLMs) and Graph Neural Networks (GNNs) are widely used in code vulnerability detection. However, GNNs often rely on aggregating information from adjacent n…
TransURL: Improving malicious URL detection with multi-layer Transformer encoding and multi-scale pyramid features
Ruitong Liu, Yanbin Wang, Zhenhao Guo +4
Machine learning progress is advancing the detection of malicious URLs. However, advanced Transformers applied to URLs face difficulties in extracting local information, character-…
PMANet: Malicious URL detection via post-trained language model guided multi-level feature attention network
Ruitong Liu, Yanbin Wang, Haitao Xu +4
The proliferation of malicious URLs has made their detection crucial for enhancing network security. While pre-trained language models offer promise, existing methods struggle with…