6 citations · 34 across the 24 of their papers we have counts for
25 papers
TTMark: Pairwise Distortion-Free Watermarking Beyond Single-Token Entropy
Ruibo Chen, Zhengmian Hu, Donghang Lu +5
Distortion-free watermarking enables reliable attribution of machine-generated text while preserving output distribution. However, existing methods operate independently on each ge…
CTRLS: Chain-of-Thought Reasoning via Latent State-Transition
Junda Wu, Yuxin Xiong, Xintong Li +7
Chain-of-thought (CoT) reasoning enables large language models (LLMs) to break down complex problems into interpretable intermediate steps, significantly enhancing model transparen…
A Personalized Conversational Benchmark: Towards Simulating Personalized Conversations
Li Li, Peilin Cai, Ryan A. Rossi +21
We present PersonaConvBench, a large-scale benchmark for evaluating personalized reasoning and generation in multi-turn conversations with large language models (LLMs). Unlike exis…
Exploring Rewriting Approaches for Different Conversational Tasks
Md Mehrab Tanjim, Ryan A. Rossi, Mike Rimer +9
Conversational assistants often require a question rewriting algorithm that leverages a subset of past interactions to provide a more meaningful (accurate) answer to the user's que…
Towards Optimal Multi-draft Speculative Decoding
Zhengmian Hu, Tong Zheng, Vignesh Viswanathan +5
Large Language Models (LLMs) have become an indispensable part of natural language processing tasks. However, autoregressive sampling has become an efficiency bottleneck. Multi-Dra…
From Selection to Generation: A Survey of LLM-based Active Learning
Yu Xia, Subhojyoti Mukherjee, Zhouhang Xie +31
Active Learning (AL) has been a powerful paradigm for improving model efficiency and performance by selecting the most informative data points for labeling and training. In recent…
Personalized Multimodal Large Language Models: A Survey
Junda Wu, Hanjia Lyu, Yu Xia +24
Multimodal Large Language Models (MLLMs) have become increasingly important due to their state-of-the-art performance and ability to integrate multiple data modalities, such as tex…
GUI Agents: A Survey
Dang Nguyen, Jian Chen, Yu Wang +27
Graphical User Interface (GUI) agents, powered by Large Foundation Models, have emerged as a transformative approach to automating human-computer interaction. These agents autonomo…
Fast and scalable Wasserstein-1 neural optimal transport solver for single-cell perturbation prediction
Yanshuo Chen, Zhengmian Hu, Wei Chen +1
\textbf{Motivation:} Predicting single-cell perturbation responses requires mapping between two unpaired single-cell data distributions. Optimal transport (OT) theory provides a pr…
A Bayesian Approach to Harnessing the Power of LLMs in Authorship Attribution
Zhengmian Hu, Tong Zheng, Heng Huang
Authorship attribution aims to identify the origin or author of a document. Traditional approaches have heavily relied on manual features and fail to capture long-range correlation…
Inevitable Trade-off between Watermark Strength and Speculative Sampling Efficiency for Language Models
Zhengmian Hu, Heng Huang
Large language models are probabilistic models, and the process of generating content is essentially sampling from the output distribution of the language model. Existing watermark…
A Survey of Small Language Models
Chien Van Nguyen, Xuan Shen, Ryan Aponte +25
Small Language Models (SLMs) have become increasingly important due to their efficiency and performance to perform various language tasks with minimal computational resources, maki…
Distortion-free Watermarks are not Truly Distortion-free under Watermark Key Collisions
Yihan Wu, Ruibo Chen, Zhengmian Hu +4
Language model (LM) watermarking techniques inject a statistical signal into LM-generated content by substituting the random sampling process with pseudo-random sampling, using wat…
Token-Level Adversarial Prompt Detection Based on Perplexity Measures and Contextual Information
Zhengmian Hu, Gang Wu, Saayan Mitra +4
In recent years, Large Language Models (LLM) have emerged as pivotal tools in various applications. However, these models are susceptible to adversarial prompt attacks, where attac…
GPT-4 Vision on Medical Image Classification -- A Case Study on COVID-19 Dataset
Ruibo Chen, Tianyi Xiong, Yihan Wu +6
This technical report delves into the application of GPT-4 Vision (GPT-4V) in the nuanced realm of COVID-19 image classification, leveraging the transformative potential of in-cont…
Unbiased Watermark for Large Language Models
Zhengmian Hu, Lichang Chen, Xidong Wu +3
The recent advancements in large language models (LLMs) have sparked a growing apprehension regarding the potential misuse. One approach to mitigating this risk is to incorporate w…
Solving a Class of Non-Convex Minimax Optimization in Federated Learning
Xidong Wu, Jianhui Sun, Zhengmian Hu +2
The minimax problems arise throughout machine learning applications, ranging from adversarial training and policy evaluation in reinforcement learning to AUROC maximization. To add…
Federated Conditional Stochastic Optimization
Xidong Wu, Jianhui Sun, Zhengmian Hu +3
Conditional stochastic optimization has found applications in a wide range of machine learning tasks, such as invariant learning, AUPRC maximization, and meta-learning. As the dema…
A Resilient and Accessible Distribution-Preserving Watermark for Large Language Models
Yihan Wu, Zhengmian Hu, Junfeng Guo +2
Watermarking techniques offer a promising way to identify machine-generated content via embedding covert information into the contents generated from language models. A challenge i…
Serverless Federated AUPRC Optimization for Multi-Party Collaborative Imbalanced Data Mining
Xidong Wu, Zhengmian Hu, Jian Pei +1
Multi-party collaborative training, such as distributed learning and federated learning, is used to address the big data challenges. However, traditional multi-party collaborative…
Decentralized Riemannian Algorithm for Nonconvex Minimax Problems
Xidong Wu, Zhengmian Hu, Heng Huang
The minimax optimization over Riemannian manifolds (possibly nonconvex constraints) has been actively applied to solve many problems, such as robust dimensionality reduction and de…
Faster Adaptive Federated Learning
Xidong Wu, Feihu Huang, Zhengmian Hu +1
Federated learning has attracted increasing attention with the emergence of distributed data. While extensive federated learning algorithms have been proposed for the non-convex di…
Fast and Scalable Adversarial Training of Kernel SVM via Doubly Stochastic Gradients
Huimin Wu, Zhengmian Hu, Bin Gu
Adversarial attacks by generating examples which are almost indistinguishable from natural examples, pose a serious threat to learning models. Defending against adversarial attacks…
AdaGDA: Faster Adaptive Gradient Descent Ascent Methods for Minimax Optimization
Feihu Huang, Xidong Wu, Zhengmian Hu
In the paper, we propose a class of faster adaptive Gradient Descent Ascent (GDA) methods for solving the nonconvex-strongly-concave minimax problems by using the unified adaptive…