681 citations · 2.7k across the 36 of their papers we have counts for
36 papers
CoCoScale: Leveraging Layer-wise Scaling to Unlock the Potential of Online LLM Serving
Jingfeng Wu, Yiyuan He, Minxian Xu +7
Online large language model (LLM) serving has become the backbone of modern AI applications, powering diverse downstream services through shared hardware clusters. However, modern…
BrownoutMoE: Structure-Aware Expert Grouping for Efficient and Accurate LLM Web-based Services
Yi Ding, Minxian Xu, Zhengxin Fang +2
Mixture-of-Experts (MoE) large language models (LLMs) are increasingly deployed in Web-facing services, where inference must be both accurate and responsive under bursty demand. Al…
RolloutPipe: Overlapping Pipelined Rollout and Training in Disaggregated On-Policy LLM Reinforcement Learning
Rongjian Chen, Jianmin Hu, Kejiang Ye +1
Large language model (LLM) post-training for reasoning increasingly relies on reinforcement learning with verifiable rewards (RLVR), where models learn from ground-truth feedback o…
SwiftCache: Efficient LLM Serving for Multi-turn Conversations with Heterogeneous KV Cache Sharing
Jianmin Hu, Minxian Xu, Sa Wang +5
Multi-turn conversation is a fundamental scenario in LLM applications, widely used in chatbots and AI agents. As the conversation evolves, historical tokens accumulate continuously…
Coordinated Scheduling for MoE LLM Serving
Yifan Sun, Zhexiang Zhang, Jiantong Jiang +5
Serving Mixture-of-Experts (MoE) large language models (LLMs) is challenging because dynamic request workloads interact with sparse expert routing, creating both data-parallel (DP)…
ORACL: Optimized Reasoning for Autoscaling via Chain of Thought with LLMs for Microservices
Haoyu Bai, Muhammed Tawfiqul Islam, Minxian Xu +1
Applications are moving away from monolithic designs to microservice and serverless architectures, where fleets of lightweight and independently deployable components run on public…
StatuScale: Status-aware and Elastic Scaling Strategy for Microservice Applications
Linfeng Wen, Minxian Xu, Sukhpal Singh Gill +4
Microservice architecture has transformed traditional monolithic applications into lightweight components. Scaling these lightweight microservices is more efficient than scaling se…
DRPC: Distributed Reinforcement Learning Approach for Scalable Resource Provisioning in Container-based Clusters
Haoyu Bai, Minxian Xu, Kejiang Ye +2
Microservices have transformed monolithic applications into lightweight, self-contained, and isolated application components, establishing themselves as a dominant paradigm for app…
Edge AI: A Taxonomy, Systematic Review and Future Directions
Sukhpal Singh Gill, Muhammed Golec, Jianmin Hu +12
Edge Artificial Intelligence (AI) incorporates a network of interconnected systems and devices that receive, cache, process, and analyze data in close communication with the locati…
Collaborative Resource Management and Workloads Scheduling in Cloud-Assisted Mobile Edge Computing across Timescales
Lujie Tang, Minxian Xu, Chengzhong Xu +1
Due to the limited resource capacity of edge servers and the high purchase costs of edge resources, service providers are facing the new challenge of how to take full advantage of…
TempoScale: A Cloud Workloads Prediction Approach Integrating Short-Term and Long-Term Information
Linfeng Wen, Minxian Xu, Adel N. Toosi +1
Cloud native solutions are widely applied in various fields, placing higher demands on the efficient management and utilization of resource platforms. To achieve the efficiency, lo…
An Interference-aware Approach for Co-located Container Orchestration with Novel Metric
Xiang Li, Linfeng Wen, Minxian Xu +1
Container orchestration technologies are widely employed in cloud computing, facilitating the co-location of online and offline services on the same infrastructure. Online services…
ChainsFormer: A Chain Latency-aware Resource Provisioning Approach for Microservices Cluster
Chenghao Song, Minxian Xu, Kejiang Ye +4
The trend towards transitioning from monolithic applications to microservices has been widely embraced in modern distributed systems and applications. This shift has resulted in th…
Practice of Alibaba Cloud on Elastic Resource Provisioning for Large-scale Microservices Cluster
Minxian Xu, Lei Yang, Yang Wang +6
Cloud-native architecture is becoming increasingly crucial for today's cloud computing environments due to the need for speed and flexibility in developing applications. It utilize…
Resource Management for GPT-based Model Deployed on Clouds: Challenges, Solutions, and Future Directions
Yongkang Dang, Minxian Xu, Kejiang Ye
The widespread adoption of the large language model (LLM), e.g. Generative Pre-trained Transformer (GPT), deployed on cloud computing environment (e.g. Azure) has led to a huge inc…
Fortaleza: The emergence of a network hub
Eric Bragion, Habiba Akter, Mohit Kumar +3
Digitalisation, accelerated by the pandemic, has brought the opportunity for companies to expand their businesses beyond their geographic location and has considerably affected net…
Transformative Effects of ChatGPT on Modern Education: Emerging Era of AI Chatbots
Sukhpal Singh Gill, Minxian Xu, Panos Patros +18
ChatGPT, an AI-based chatbot, was released to provide coherent and useful replies based on analysis of large volumes of data. In this article, leading scientists, researchers and e…
AI-based Fog and Edge Computing: A Systematic Review, Taxonomy and Future Directions
Sundas Iftikhar, Sukhpal Singh Gill, Chenghao Song +15
Resource management in computing is a very challenging problem that involves making sequential decisions. Resource limitations, resource heterogeneity, dynamic and diverse nature o…
Cost Control and Efficiency Optimization in Maintainability Implementation of Wireless Sensor Networks based on Serverless Computing
Tiannan Gao, Minxian Xu
Wireless sensor network (WSN) has been developed for decades and have performed well in the performance, power consumption, and congestion control. However, the following problems…
AI for Next Generation Computing: Emerging Trends and Future Directions
Sukhpal Singh Gill, Minxian Xu, Carlo Ottaviani +19
Autonomic computing investigates how systems can achieve (user) specified control outcomes on their own, without the intervention of a human operator. Autonomic computing fundament…
EsDNN: Deep Neural Network based Multivariate Workload Prediction Approach in Cloud Environment
Minxian Xu, Chenghao Song, Huaming Wu +3
Cloud computing has been regarded as a successful paradigm for IT industry by providing benefits for both service providers and customers. In spite of the advantages, cloud computi…
HUNTER: AI based Holistic Resource Management for Sustainable Cloud Computing
Shreshth Tuli, Sukhpal Singh Gill, Minxian Xu +8
The worldwide adoption of cloud data centers (CDCs) has given rise to the ubiquitous demand for hosting application services on the cloud. Further, contemporary data-intensive indu…
Prepartition: Load Balancing Approach for Virtual Machine Reservations in a Cloud Data Center
Wenhong Tian, Minxian Xu, Guangyao Zhou +3
Load balancing is vital for the efficient and long-term operation of cloud data centers. With virtualization, post (reactive) migration of virtual machines after allocation is the…
Machine Learning-based Orchestration of Containers: A Taxonomy and Future Directions
Zhiheng Zhong, Minxian Xu, Maria Alejandra Rodriguez +2
Containerization is a lightweight application virtualization technology, providing high environmental consistency, operating system distribution portability, and resource isolation…