activity
20192023
most citedOliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

150 citations · 415 across the 37 of their papers we have counts for

collaborators
Showing 2023Show all

12 papers · 1 filter

cs.AI2023★ 3 cited

ProAgent: Building Proactive Cooperative Agents with Large Language Models

Ceyao Zhang, Kaijie Yang, Siyi Hu +12

Building agents with adaptive behavior in cooperative tasks stands as a paramount goal in the realm of multi-agent systems. Current approaches to developing cooperative agents rely…

cs.AR2023★ 1 cited

A Dataflow Compiler for Efficient LLM Inference using Custom Microscaling Formats

Jianyi Cheng, Cheng Zhang, Zhewen Yu +3

Model quantization represents both parameters (weights) and intermediate values (activations) in a more compact format, thereby directly reducing both computational and memory cost…

cs.LG2023★ 6 cited

Causal Reinforcement Learning: A Survey

Zhihong Deng, Jing Jiang, Guodong Long +1

Reinforcement learning is an essential paradigm for solving sequential decision problems under uncertainty. Despite many remarkable achievements in recent decades, applying reinfor…

cs.LG2023

Nonparametric Iterative Machine Teaching

Chen Zhang, Xiaofeng Cao, Weiyang Liu +2

In this paper, we consider the problem of Iterative Machine Teaching (IMT), where the teacher provides examples to the learner iteratively such that the learner can achieve fast co…

cs.LG2023

Temporal-spatial Correlation Attention Network for Clinical Data Analysis in Intensive Care Unit

Weizhi Nie, Yuhe Yu, Chen Zhang +3

In recent years, medical information technology has made it possible for electronic health record (EHR) to store fairly complete clinical data. This has brought health care into th…

cs.NI2023★ 35 cited

One for All: Unified Workload Prediction for Dynamic Multi-tenant Edge Cloud Platforms

Shaoyuan Huang, Zheng Wang, Heng Zhang +3

Workload prediction in multi-tenant edge cloud platforms (MT-ECP) is vital for efficient application deployment and resource provisioning. However, the heterogeneous application pa…

cs.CL2023★ 1 cited

Improving the Robustness of Summarization Systems with Dual Augmentation

Xiuying Chen, Guodong Long, Chongyang Tao +4

A robust summarization system should be able to capture the gist of the document, regardless of the specific word choices or noise in the input. In this work, we first explore the…

cs.CL2023

Task-agnostic Distillation of Encoder-Decoder Language Models

Chen Zhang, Yang Yang, Jingang Wang +1

Finetuning pretrained language models (LMs) have enabled appealing performance on a diverse array of tasks. The intriguing task-agnostic property has driven a shifted focus from ta…

cs.CL2023★ 1 cited

Lifting the Curse of Capacity Gap in Distilling Language Models

Chen Zhang, Yang Yang, Jiahao Liu +4

Pretrained language models (LMs) have shown compelling performance on various downstream tasks, but unfortunately they require a tremendous amount of inference compute. Knowledge d…

q-fin.ST2023★ 140 cited

Deep learning models for price forecasting of financial time series: A review of recent advancements: 2020-2022

Cheng Zhang, Nilam Nur Amir Sjarif, Roslina Ibrahim

Accurately predicting the prices of financial time series is essential and challenging for the financial sector. Owing to recent advancements in deep learning techniques, deep lear…

cs.AR2023★ 150 cited

OliVe: Accelerating Large Language Models via Hardware-friendly Outlier-Victim Pair Quantization

Cong Guo, Jiaming Tang, Weiming Hu +6

Transformer-based large language models (LLMs) have achieved great success with the growing model size. LLMs' size grows by every two years, which outpaces the hardware…

cs.IR2023

Modular Retrieval for Generalization and Interpretation

Juhao Liang, Chen Zhang, Zhengyang Tang +3

New retrieval tasks have always been emerging, thus urging the development of new retrieval models. However, instantiating a retrieval model for each new retrieval task is resource…