10 citations · 11 across the 2 of their papers we have counts for
2 papers
cs.CL2023★ 1 cited
Autoregressive Modeling with Lookahead Attention
Li Du, Hongyuan Mei, Jason Eisner
To predict the next token, autoregressive models ordinarily examine the past. Could they also benefit from also examining hypothetical futures? We consider a novel Transformer-base…
cs.LG2022★ 10 cited
Transformer Embeddings of Irregularly Spaced Events and Their Participants
Chenghao Yang, Hongyuan Mei, Jason Eisner
The neural Hawkes process (Mei & Eisner, 2017) is a generative model of irregularly spaced sequences of discrete events. To handle complex domains with many event types, Mei et al.…