17 citations · 22 across the 9 of their papers we have counts for
8 papers · 1 filter
Prompting and Fine-Tuning of Small LLMs for Length-Controllable Telephone Call Summarization
David Thulke, Yingbo Gao, Rricha Jalota +2
This paper explores the rapid development of a telephone call summarization system utilizing large language models (LLMs). Our approach involves initial experiments with prompting…
Improving Language Model Integration for Neural Machine Translation
Christian Herold, Yingbo Gao, Mohammad Zeineldeen +1
The integration of language models for neural machine translation has been extensively studied in the past. It has been shown that an external language model, trained on additional…
Is Encoder-Decoder Redundant for Neural Machine Translation?
Yingbo Gao, Christian Herold, Zijian Yang +1
Encoder-decoder architecture is widely adopted for sequence-to-sequence modeling tasks. For machine translation, despite the evolution from long short-term memory networks to Trans…
Revisiting Checkpoint Averaging for Neural Machine Translation
Yingbo Gao, Christian Herold, Zijian Yang +1
Checkpoint averaging is a simple and effective method to boost the performance of converged neural machine translation models. The calculation is cheap to perform and the fact that…
Diving Deep into Context-Aware Neural Machine Translation
Jingjing Huo, Christian Herold, Yingbo Gao +3
Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation…
Exploring Kernel Functions in the Softmax Layer for Contextual Word Classification
Yingbo Gao, Christian Herold, Weiyue Wang +1
Prominently used in support vector machines and logistic regressions, kernel functions (kernels) can implicitly map data points into high dimensional spaces and make it easier to l…
uniblock: Scoring and Filtering Corpus with Unicode Block Information
Yingbo Gao, Weiyue Wang, Hermann Ney
The preprocessing pipelines in Natural Language Processing usually involve a step of removing sentences consisted of illegal characters. The definition of illegal characters and th…
Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies
Yunsu Kim, Yingbo Gao, Hermann Ney
Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocab…