35 citations · 38 across the 10 of their papers we have counts for
4 papers · 1 filter
Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning
Tao Zhang, Ning Yan, Masood Mortazavi +3
Large language models (LLMs) pre-trained on massive corpora have demonstrated impressive few-shot learning capability on many NLP tasks. Recasting an NLP task into a text-to-text g…
Enhancing Long Context Performance in LLMs Through Inner Loop Query Mechanism
Yimin Tang, Yurong Xu, Ning Yan +1
Transformers have a quadratic scaling of computational complexity with input size, which limits the input context window size of large language models (LLMs) in both training and i…
Fusion of regional and sparse attention in Vision Transformers
Nabil Ibtehaz, Ning Yan, Masood Mortazavi +1
Modern vision transformers leverage visually inspired local interaction between pixels through attention computed within window or grid regions, in contrast to the global attention…
ACC-ViT : Atrous Convolution's Comeback in Vision Transformers
Nabil Ibtehaz, Ning Yan, Masood Mortazavi +1
Transformers have elevated to the state-of-the-art vision architectures through innovations in attention mechanism inspired from visual perception. At present two classes of attent…