4 citations · 15 across the 10 of their papers we have counts for
10 papers
How Do Transformers Learn Topic Structure: Towards a Mechanistic Understanding
Yuchen Li, Yuanzhi Li, Andrej Risteski
While the successes of transformers across many domains are indisputable, accurate understanding of the learning mechanics is still largely lacking. Their capabilities have been pr…
EDUKG: a Heterogeneous Sustainable K-12 Educational Knowledge Graph
Bowen Zhao, Jiuding Sun, Bin Xu +9
Web and artificial intelligence technologies, especially semantic web and knowledge graph (KG), have recently raised significant attention in educational scenarios. Nevertheless, s…
Contrasting the landscape of contrastive and non-contrastive learning
Ashwini Pokle, Jinjin Tian, Yuchen Li +1
A lot of recent advances in unsupervised feature learning are based on designing features which are invariant under semantic data augmentations. A common way to do this is contrast…
Improving greedy core-set configurations for active learning with uncertainty-scaled distances
Yuchen Li, Frank Rudzicz
We scale perceived distances of the core-set algorithm by a factor of uncertainty and search for low-confidence configurations, finding significant improvements in sample efficienc…
Privacy Threats Analysis to Secure Federated Learning
Yuchen Li, Yifan Bao, Liyao Xiang +4
Federated learning is emerging as a machine learning technique that trains a model across multiple decentralized parties. It is renowned for preserving privacy as the data never le…
The Limitations of Limited Context for Constituency Parsing
Yuchen Li, Andrej Risteski
Incorporating syntax into neural approaches in NLP has a multitude of practical and scientific benefits. For instance, a language model that is syntax-aware is likely to be able to…
Variations on the Chebyshev-Lagrange Activation Function
Yuchen Li, Frank Rudzicz, Jekaterina Novikova
We seek to improve the data efficiency of neural networks and present novel implementations of parameterized piece-wise polynomial activation functions. The parameters are the y-co…
DeepConsensus: using the consensus of features from multiple layers to attain robust image classification
Yuchen Li, Safwan Hossain, Kiarash Jamali +1
We consider a classifier whose test set is exposed to various perturbations that are not present in the training set. These test samples still contain enough features to map them t…
ChainGAN: A sequential approach to GANs
Safwan Hossain, Kiarash Jamali, Yuchen Li +1
We propose a new architecture and training methodology for generative adversarial networks. Current approaches attempt to learn the transformation from a noise sample to a generate…
Technical Report: Accelerating Dynamic Graph Analytics on GPUs
Mo Sha, Yuchen Li, Bingsheng He +1
As graph analytics often involves compute-intensive operations, GPUs have been extensively used to accelerate the processing. However, in many applications such as social networks,…