31 citations · 34 across the 4 of their papers we have counts for
4 papers
Approximating Human-Like Few-shot Learning with GPT-based Compression
Cynthia Huang, Yuqing Xie, Zhiying Jiang +2
In this work, we conceptualize the learning process as information compression. We seek to equip generative pre-trained models with human-like learning capabilities that enable dat…
Building an Efficiency Pipeline: Commutativity and Cumulativeness of Efficiency Operators for Transformers
Ji Xin, Raphael Tang, Zhiying Jiang +2
There exists a wide variety of efficiency methods for natural language processing (NLP) tasks, such as pruning, distillation, dynamic inference, quantization, etc. We can consider…
Investigating the Limitations of Transformers with Simple Arithmetic Tasks
Rodrigo Nogueira, Zhiying Jiang, Jimmy Lin
The ability to perform arithmetic tasks is a remarkable trait of human intelligence and might form a critical component of more complex reasoning tasks. In this work, we investigat…
Navigation-Based Candidate Expansion and Pretrained Language Models for Citation Recommendation
Rodrigo Nogueira, Zhiying Jiang, Kyunghyun Cho +1
Citation recommendation systems for the scientific literature, to help authors find papers that should be cited, have the potential to speed up discoveries and uncover new routes f…