17 citations · 22 across the 9 of their papers we have counts for
11 papers
Prompting and Fine-Tuning of Small LLMs for Length-Controllable Telephone Call Summarization
David Thulke, Yingbo Gao, Rricha Jalota +2
This paper explores the rapid development of a telephone call summarization system utilizing large language models (LLMs). Our approach involves initial experiments with prompting…
ClimateGPT: Towards AI Synthesizing Interdisciplinary Research on Climate Change
David Thulke, Yingbo Gao, Petrus Pelser +23
This paper introduces ClimateGPT, a model family of domain-specific large language models that synthesize interdisciplinary research on climate change. We trained two 7B models fro…
Improving Language Model Integration for Neural Machine Translation
Christian Herold, Yingbo Gao, Mohammad Zeineldeen +1
The integration of language models for neural machine translation has been extensively studied in the past. It has been shown that an external language model, trained on additional…
Does Joint Training Really Help Cascaded Speech Translation?
Viet Anh Khoa Tran, David Thulke, Yingbo Gao +2
Currently, in speech translation, the straightforward approach - cascading a recognition system with a translation system - delivers state-of-the-art results. However, fundamental…
Is Encoder-Decoder Redundant for Neural Machine Translation?
Yingbo Gao, Christian Herold, Zijian Yang +1
Encoder-decoder architecture is widely adopted for sequence-to-sequence modeling tasks. For machine translation, despite the evolution from long short-term memory networks to Trans…
Revisiting Checkpoint Averaging for Neural Machine Translation
Yingbo Gao, Christian Herold, Zijian Yang +1
Checkpoint averaging is a simple and effective method to boost the performance of converged neural machine translation models. The calculation is cheap to perform and the fact that…
Diving Deep into Context-Aware Neural Machine Translation
Jingjing Huo, Christian Herold, Yingbo Gao +3
Context-aware neural machine translation (NMT) is a promising direction to improve the translation quality by making use of the additional context, e.g., document-level translation…
Investigation of Large-Margin Softmax in Neural Language Modeling
Jingjing Huo, Yingbo Gao, Weiyue Wang +2
To encourage intra-class compactness and inter-class separability among trainable feature vectors, large-margin softmax methods are developed and widely applied in the face recogni…
Exploring Kernel Functions in the Softmax Layer for Contextual Word Classification
Yingbo Gao, Christian Herold, Weiyue Wang +1
Prominently used in support vector machines and logistic regressions, kernel functions (kernels) can implicitly map data points into high dimensional spaces and make it easier to l…
uniblock: Scoring and Filtering Corpus with Unicode Block Information
Yingbo Gao, Weiyue Wang, Hermann Ney
The preprocessing pipelines in Natural Language Processing usually involve a step of removing sentences consisted of illegal characters. The definition of illegal characters and th…
Effective Cross-lingual Transfer of Neural Machine Translation Models without Shared Vocabularies
Yunsu Kim, Yingbo Gao, Hermann Ney
Transfer learning or multilingual model is essential for low-resource neural machine translation (NMT), but the applicability is limited to cognate languages by sharing their vocab…