94 citations · 208 across the 10 of their papers we have counts for
12 papers
The BigScience ROOTS Corpus: A 1.6TB Composite Multilingual Dataset
Hugo Laurençon, Lucile Saulnier, Thomas Wang +51
As language models grow ever larger, the need for large-scale high-quality text datasets has never been more pressing, especially in multilingual settings. The BigScience workshop,…
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
BigScience Workshop, :, Teven Le Scao +391
Large language models (LLMs) have been shown to be able to perform new tasks based on a few demonstrations or natural language instructions. While these capabilities have led to wi…
MTet: Multi-domain Translation for English and Vietnamese
Chinh Ngo, Trieu H. Trinh, Long Phan +5
We introduce MTet, the largest publicly available parallel corpus for English-Vietnamese translation. MTet consists of 4.2M high-quality training sentence pairs and a multi-domain…
Enriching Biomedical Knowledge for Low-resource Language Through Large-Scale Translation
Long Phan, Tai Dang, Hieu Tran +4
Biomedical data and benchmarks are highly valuable yet very limited in low-resource languages other than English such as Vietnamese. In this paper, we make use of a state-of-the-ar…
ViT5: Pretrained Text-to-Text Transformer for Vietnamese Language Generation
Long Phan, Hieu Tran, Hieu Nguyen +1
We present ViT5, a pretrained Transformer-based encoder-decoder model for the Vietnamese language. With T5-style self-supervised pretraining, ViT5 is trained on a large corpus of h…
Transfer Reinforcement Learning for Differing Action Spaces via Q-Network Representations
Nathan Beck, Abhiramon Rajasekharan, Hieu Tran
Transfer learning approaches in reinforcement learning aim to assist agents in learning their target domains by leveraging the knowledge learned from other agents that have been tr…
Predicting Job Titles from Job Descriptions with Multi-label Text Classification
Hieu Trung Tran, Hanh Hong Phuc Vo, Son T. Luu
Finding a suitable job and hunting for eligible candidates are important to job seeking and human resource agencies. With the vast information about job descriptions, employees and…
VieSum: How Robust Are Transformer-based Models on Vietnamese Summarization?
Hieu Nguyen, Long Phan, James Anibal +2
Text summarization is a challenging task within natural language processing that involves text generation from lengthy input sequences. While this task has been widely studied in E…
CoTexT: Multi-task Learning with Code-Text Transformer
Long Phan, Hieu Tran, Daniel Le +4
We present CoTexT, a pre-trained, transformer-based encoder-decoder model that learns the representative context between natural language (NL) and programming language (PL). Using…
SciFive: a text-to-text transformer model for biomedical literature
Long N. Phan, James T. Anibal, Hieu Tran +4
In this report, we introduce SciFive, a domain-specific T5 model that has been pre-trained on large biomedical corpora. Our model outperforms the current SOTA methods (i.e. BERT, B…
Hierarchical Transformer Encoders for Vietnamese Spelling Correction
Hieu Tran, Cuong V. Dinh, Long Phan +1
In this paper, we propose a Hierarchical Transformer model for Vietnamese spelling correction problem. The model consists of multiple Transformer encoders and utilizes both charact…
Detection and Prediction of Users Attitude Based on Real-Time and Batch Sentiment Analysis of Facebook Comments
Hieu Tran, Maxim Shcherbakov
The most of the people have their account on social networks (e.g. Facebook, Vkontakte) where they express their attitude to different situations and events. Facebook provides only…