Deploying Multi-task Online Server with Large Language Model

Yincen Qu, Chao Ma, Xiangying Dai +3

In the industry, numerous tasks are deployed online. Traditional approaches often tackle each task separately by its own network, which leads to excessive costs for developing and…