24 citations · 60 across the 25 of their papers we have counts for
25 papers
Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
Hao Chen, Xing Tang, Qirui Liu +6
Large Language Models (LLMs) have significantly advanced online data services, particularly in the domain of financial question answering (FinQA). However, such systems remain susc…
Looking Farther with Confidence: Uncertainty-Guided Future Learning for Sequential Recommendation
Ziqiang Cui, Xing Tang, Peiyang Liu +4
Sequential recommendation effectively models dynamic user interests but continues to face challenges related to data sparsity. While self-supervised learning has alleviated this is…
Data-Driven Function Calling Improvements in Large Language Model for Online Financial QA
Xing Tang, Hao Chen, Shiwei Li +7
Large language models (LLMs) have been incorporated into numerous industrial applications. Meanwhile, a vast array of API assets is scattered across various functions in the financ…
Step 3.5 Flash: Open Frontier-Level Intelligence with 11B Active Parameters
Ailin Huang, Ang Li, Aobo Kong +213
We introduce Step 3.5 Flash, a sparse Mixture-of-Experts (MoE) model that bridges frontier-level agentic intelligence and computational efficiency. We focus on what matters most wh…
Nonlinearity as Rank: Generative Low-Rank Adapter with Radial Basis Functions
Yihao Ouyang, Shiwei Li, Haozhao Wang +7
Low-rank adaptation (LoRA) approximates the update of a pretrained weight matrix using the product of two low-rank matrices. However, standard LoRA follows an explicit-rank paradig…
Step-DeepResearch Technical Report
Chen Hu, Haikuo Du, Heng Wang +64
As LLMs shift toward autonomous agents, Deep Research has emerged as a pivotal metric. However, existing academic benchmarks like BrowseComp often fail to meet real-world demands f…
Automated Information Flow Selection for Multi-scenario Multi-task Recommendation
Chaohua Yang, Dugang Liu, Shiwei Li +6
Multi-scenario multi-task recommendation (MSMTR) systems must address recommendation demands across diverse scenarios while simultaneously optimizing multiple objectives, such as c…
Beyond Higher Rank: Token-wise Input-Output Projections for Efficient Low-Rank Adaptation
Shiwei Li, Xiandi Luo, Haozhao Wang +6
Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). LoRA essentially describes the projection of an input spa…
FedBiF: Communication-Efficient Federated Learning via Bits Freezing
Shiwei Li, Qunwei Li, Haozhao Wang +3
Federated learning (FL) is an emerging distributed machine learning paradigm that enables collaborative model training without sharing local data. Despite its advantages, FL suffer…
AttriPrompt: Dynamic Prompt Composition Learning for CLIP
Qiqi Zhan, Shiwei Li, Qingjie Liu +1
The evolution of prompt learning methodologies has driven exploration of deeper prompt designs to enhance model performance. However, current deep text prompting approaches suffer…
BoRA: Towards More Expressive Low-Rank Adaptation with Block Diversity
Shiwei Li, Xiandi Luo, Haozhao Wang +6
Low-rank adaptation (LoRA) is a parameter-efficient fine-tuning (PEFT) method widely used in large language models (LLMs). It approximates the update of a pretrained weight matrix…
Less Is More: Elevating RAG via Performance-Driven Context Compression
Ziqiang Cui, Yunpeng Weng, Xing Tang +7
Retrieval-Augmented Generation (RAG) has emerged as a promising paradigm for improving the timeliness of knowledge updates and the factual accuracy of large language models. Howeve…
The Power of Many: Synergistic Unification of Diverse Augmentations for Efficient Adversarial Robustness
Wang Yu-Hang, Shiwei Li, Jianxiang Liao +3
Adversarial perturbations pose a significant threat to deep learning models. Adversarial Training (AT), the predominant defense method, faces challenges of high computational costs…
Ignition Phase : Standard Training for Fast Adversarial Robustness
Wang Yu-Hang, Liu ying, Fang liang +6
Adversarial Training (AT) is a cornerstone defense, but many variants overlook foundational feature representations by primarily focusing on stronger attack generation. We introduc…
Beyond Zero Initialization: Investigating the Impact of Non-Zero Initialization on LoRA Fine-Tuning Dynamics
Shiwei Li, Xiandi Luo, Xing Tang +6
Low-rank adaptation (LoRA) is a widely used parameter-efficient fine-tuning method. In standard LoRA layers, one of the matrices, or , is initialized to zero, ensuring that…
The Panaceas for Improving Low-Rank Decomposition in Communication-Efficient Federated Learning
Shiwei Li, Xiandi Luo, Haozhao Wang +6
To improve the training efficiency of federated learning (FL), previous research has employed low-rank decomposition techniques to reduce communication overhead. In this paper, we…
Semantic Retrieval Augmented Contrastive Learning for Sequential Recommendation
Ziqiang Cui, Yunpeng Weng, Xing Tang +8
Contrastive learning has shown effectiveness in improving sequential recommendation models. However, existing methods still face challenges in generating high-quality contrastive p…
ONER: Online Experience Replay for Incremental Anomaly Detection
Yizhou Jin, Jiahui Zhu, Guodong Wang +5
Incremental anomaly detection aims to sequentially identify defects in industrial product lines but suffers from catastrophic forgetting, primarily due to knowledge overwriting dur…
Mixed-Precision Embeddings for Large-Scale Recommendation Models
Shiwei Li, Zhuoqi Hu, Xing Tang +6
Embedding techniques have become essential components of large databases in the deep learning era. By encoding discrete entities, such as words, items, or graph nodes, into continu…
A Survey on Data Synthesis and Augmentation for Large Language Models
Ke Wang, Jiahui Zhu, Minjie Ren +8
The success of Large Language Models (LLMs) is inherently linked to the availability of vast, diverse, and high-quality data for training and evaluation. However, the growth rate o…
Masked Random Noise for Communication Efficient Federated Learning
Shiwei Li, Yingyi Cheng, Haozhao Wang +7
Federated learning is a promising distributed training paradigm that effectively safeguards data privacy. However, it may involve significant communication costs, which hinders tra…
FedBAT: Communication-Efficient Federated Learning via Learnable Binarization
Shiwei Li, Wenchao Xu, Haozhao Wang +7
Federated learning is a promising distributed machine learning paradigm that can effectively exploit large-scale data without exposing users' privacy. However, it may incur signifi…
Embedding Compression in Recommender Systems: A Survey
Shiwei Li, Huifeng Guo, Xing Tang +4
To alleviate the problem of information explosion, recommender systems are widely deployed to provide personalized information filtering services. Usually, embedding tables are emp…
DSD-DA: Distillation-based Source Debiasing for Domain Adaptive Object Detection
Yongchao Feng, Shiwei Li, Yingjie Gao +4
Though feature-alignment based Domain Adaptive Object Detection (DAOD) methods have achieved remarkable progress, they ignore the source bias issue, i.e., the detector tends to acq…