26 citations · 46 across the 12 of their papers we have counts for
7 papers · 1 filter
An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
Tong Wu, Yanpeng Zhao, Zilong Zheng
Recently, many methods have been developed to extend the context length of pre-trained large language models (LLMs), but they often require fine-tuning at the target length ($\gg4K…
On the Transferability of Visually Grounded PCFGs
Yanpeng Zhao, Ivan Titov
There has been a significant surge of interest in visually grounded grammar induction in recent times. While a variety of models have been developed for the task and have demonstra…
An Empirical Study of Compound PCFGs
Yanpeng Zhao, Ivan Titov
Compound probabilistic context-free grammars (C-PCFGs) have recently established a new state of the art for unsupervised phrase-structure grammar induction. However, due to the hig…
Visually Grounded Compound PCFGs
Yanpeng Zhao, Ivan Titov
Exploiting visual groundings for language understanding has recently been drawing much attention. In this work, we study visually grounded grammar induction and learn a constituenc…
Unsupervised Transfer of Semantic Role Models from Verbal to Nominal Domain
Yanpeng Zhao, Ivan Titov
Semantic role labeling (SRL) is an NLP task involving the assignment of predicate arguments to types, called semantic roles. Though research on SRL has primarily focused on verbal…
Language Style Transfer from Sentences with Arbitrary Unknown Styles
Yanpeng Zhao, Wei Bi, Deng Cai +3
Language style transfer is the problem of migrating the content of a source sentence to a target style. In many of its applications, parallel training data are not available and so…
Gaussian Mixture Latent Vector Grammars
Yanpeng Zhao, Liwen Zhang, Kewei Tu
We introduce Latent Vector Grammars (LVeGs), a new framework that extends latent variable grammars such that each nonterminal symbol is associated with a continuous vector space re…