11 citations · 16 across the 7 of their papers we have counts for
7 papers
Autonomous Data Selection with Zero-shot Generative Classifiers for Mathematical Texts
Yifan Zhang, Yifan Luo, Yang Yuan +1
We present Autonomous Data Selection (AutoDS), a method that leverages base language models themselves as zero-shot "generative classifiers" to automatically curate high-quality ma…
Information Flow in Self-Supervised Learning
Zhiquan Tan, Jingqin Yang, Weiran Huang +2
In this paper, we conduct a comprehensive analysis of two dual-branch (Siamese architecture) self-supervised learning approaches, namely Barlow Twins and spectral contrastive learn…
Cumulative Reasoning with Large Language Models
Yifan Zhang, Jingqin Yang, Yang Yuan +1
Recent advancements in large language models (LLMs) have shown remarkable progress, yet their ability to solve complex problems remains limited. In this work, we introduce Cumulati…
Matrix Information Theory for Self-Supervised Learning
Yifan Zhang, Zhiquan Tan, Jingqin Yang +2
The maximum entropy encoding framework provides a unified perspective for many non-contrastive learning methods like SimSiam, Barlow Twins, and MEC. Inspired by this framework, we…
RelationMatch: Matching In-batch Relationships for Semi-supervised Learning
Yifan Zhang, Jingqin Yang, Zhiquan Tan +1
Semi-supervised learning has emerged as a pivotal approach for leveraging scarce labeled data alongside abundant unlabeled data. Despite significant progress, prevailing SSL method…
Contrastive Learning Is Spectral Clustering On Similarity Graph
Zhiquan Tan, Yifan Zhang, Jingqin Yang +1
Contrastive learning is a powerful self-supervised learning method, but we have a limited theoretical understanding of how it works and why it works. In this paper, we prove that c…
Trade-off Between Efficiency and Consistency for Removal-based Explanations
Yifan Zhang, Haowei He, Zhiquan Tan +1
In the current landscape of explanation methodologies, most predominant approaches, such as SHAP and LIME, employ removal-based techniques to evaluate the impact of individual feat…