626 citations · 974 across the 18 of their papers we have counts for
4 papers · 1 filter
MixCE: Training Autoregressive Language Models by Mixing Forward and Reverse Cross-Entropies
Shiyue Zhang, Shijie Wu, Ozan Irsoy +4
Autoregressive language models are trained by minimizing the cross-entropy of the model distribution Q relative to the data distribution P -- that is, minimizing the forward cross-…
BloombergGPT: A Large Language Model for Finance
Shijie Wu, Ozan Irsoy, Steven Lu +6
The use of NLP in the realm of financial technology is broad and complex, with applications ranging from sentiment analysis and named entity recognition to question answering. Larg…
Distillation of encoder-decoder transformers for sequence labelling
Marco Farina, Duccio Pappadopulo, Anant Gupta +3
Driven by encouraging results on a wide range of tasks, the field of NLP is experiencing an accelerated race to develop bigger language models. This race for bigger models has also…
Weakly Supervised Headline Dependency Parsing
Adrian Benton, Tianze Shi, Ozan İrsoy +1
English news headlines form a register with unique syntactic properties that have been documented in linguistics literature since the 1930s. However, headlines have received surpri…