activity
20242026
most citedOneBit: Towards Extremely Low-bit Large Language Models

8 citations · 18 across the 43 of their papers we have counts for

collaborators
Showing 2024Show all

17 papers · 1 filter

cs.CL2024

SCITAT: A Question Answering Benchmark for Scientific Tables and Text Covering Diverse Reasoning Types

Xuanliang Zhang, Dingzirui Wang, Baoxin Wang +6

Scientific question answering (SQA) is an important task aimed at answering questions based on papers. However, current SQA datasets have limited reasoning types and neglect the re…

cs.LG2024

CRVQ: Channel-Relaxed Vector Quantization for Extreme Compression of LLMs

Yuzhuang Xu, Shiyu Ji, Qingfu Zhu +1

Powerful large language models (LLMs) are increasingly expected to be deployed with lower computational costs, enabling their capabilities on resource-constrained devices. Post-tra…

cs.CL2024

In-Context Transfer Learning: Demonstration Synthesis by Transferring Similar Tasks

Dingzirui Wang, Xuanliang Zhang, Qiguang Chen +9

In-context learning (ICL) is an effective approach to help large language models (LLMs) adapt to various tasks by providing demonstrations of the target task. Considering the high…

cs.CL2024

FLEXTAF: Enhancing Table Reasoning with Flexible Tabular Formats

Xuanliang Zhang, Dingzirui Wang, Longxu Dou +4

The table reasoning task aims to answer the question according to the given table. Currently, using Large Language Models (LLMs) is the predominant method for table reasoning. Most…

cs.CL2024★ 3 cited

DAC: Decomposed Automation Correction for Text-to-SQL

Dingzirui Wang, Longxu Dou, Xuanliang Zhang +2

Text-to-SQL is an important task that helps people obtain information from databases by automatically generating SQL queries. Considering the brilliant performance, approaches base…

cs.CL2024

Turning Trash into Treasure: Accelerating Inference of Large Language Models with Token Recycling

Xianzhen Luo, Yixuan Wang, Qingfu Zhu +4

Massive parameters of LLMs have made inference latency a fundamental bottleneck. Speculative decoding represents a lossless approach to accelerate inference through a guess-and-ver…

cs.CL2024

Improving Grammatical Error Correction via Contextual Data Augmentation

Yixuan Wang, Baoxin Wang, Yijun Liu +3

Nowadays, data augmentation through synthetic data has been widely used in the field of Grammatical Error Correction (GEC) to alleviate the problem of data scarcity. However, these…

cs.CL2024

Make Some Noise: Unlocking Language Model Parallel Inference Capability through Noisy Training

Yixuan Wang, Xianzhen Luo, Fuxuan Wei +6

Existing speculative decoding methods typically require additional model structure and training processes to assist the model for draft token generation. This makes the migration o…

cs.SE2024

Self-Constructed Context Decompilation with Fined-grained Alignment Enhancement

Yunlong Feng, Dechuan Teng, Yang Xu +5

Decompilation transforms compiled code back into a high-level programming language for analysis when source code is unavailable. Previous work has primarily focused on enhancing de…

cs.CL2024

Semi-Instruct: Bridging Natural-Instruct and Self-Instruct for Code Large Language Models

Xianzhen Luo, Qingfu Zhu, Zhiming Zhang +4

Instruction tuning plays a pivotal role in Code Large Language Models (Code LLMs) for the task of program synthesis. Presently, two dominant paradigms for collecting tuning data ar…

cs.CL2024

Exploring Hybrid Question Answering via Program-based Prompting

Qi Shi, Han Cui, Haofeng Wang +3

Question answering over heterogeneous data requires reasoning over diverse sources of data, which is challenging due to the large scale of information and organic coupling of heter…

cs.CL2024

Enhancing Numerical Reasoning with the Guidance of Reliable Reasoning Processes

Dingzirui Wang, Longxu Dou, Xuanliang Zhang +2

Numerical reasoning is an essential ability for NLP systems to handle numeric information. Recent research indicates that fine-tuning a small-scale model to learn generating reason…

cs.CL2024★ 1 cited

A Survey of Table Reasoning with Large Language Models

Xuanliang Zhang, Dingzirui Wang, Longxu Dou +2

Table reasoning, which aims to generate the corresponding answer to the question following the user requirement according to the provided table, and optionally a text description o…

cs.CL2024★ 8 cited

OneBit: Towards Extremely Low-bit Large Language Models

Yuzhuang Xu, Xu Han, Zonghan Yang +5

Model quantification uses low bit-width values to represent the weight matrices of existing models to be quantized, which is a promising approach to reduce both storage and computa…

cs.CL2024

Python is Not Always the Best Choice: Embracing Multilingual Program of Thoughts

Xianzhen Luo, Qingfu Zhu, Zhiming Zhang +5

Program of Thoughts (PoT) is an approach characterized by its executable intermediate steps, which ensure the accuracy of the logical calculations in the reasoning process. Current…

cs.CL2024

MURRE: Multi-Hop Table Retrieval with Removal for Open-Domain Text-to-SQL

Xuanliang Zhang, Dingzirui Wang, Longxu Dou +2

The open-domain text-to-SQL task aims to retrieve question-relevant tables from massive databases and generate SQL. However, the performance of current methods is constrained by si…

cs.CL2024

Improving Demonstration Diversity by Human-Free Fusing for Text-to-SQL

Dingzirui Wang, Longxu Dou, Xuanliang Zhang +2

Currently, the in-context learning method based on large language models (LLMs) has become the mainstream of text-to-SQL research. Previous works have discussed how to select demon…