activity
20242026
most citedExploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scripts

1 citations · 2 across the 9 of their papers we have counts for

collaborators
Showing 2024Show all

5 papers · 1 filter

cs.CL2024

A Federated Approach to Few-Shot Hate Speech Detection for Marginalized Communities

Haotian Ye, Axel Wisiorek, Antonis Maronikolakis +2

Hate speech online remains an understudied issue for marginalized communities, particularly in the Global South, which includes developing societies with increasing internet penetr…

cs.CL2024

LangSAMP: Language-Script Aware Multilingual Pretraining

Yihong Liu, Haotian Ye, Chunlan Ma +2

Recent multilingual pretrained language models (mPLMs) often avoid using language embeddings -- learnable vectors assigned to individual languages. However, this places a significa…

cs.CL2024★ 1 cited

How Transliterations Improve Crosslingual Alignment

Yihong Liu, Mingyang Wang, Amir Hossein Kargaran +6

Recent studies have shown that post-aligning multilingual pretrained language models (mPLMs) using alignment objectives on both original and transliterated data can improve crossli…

cs.CL2024★ 1 cited

Exploring the Role of Transliteration in In-Context Learning for Low-resource Languages Written in Non-Latin Scripts

Chunlan Ma, Yihong Liu, Haotian Ye +1

Decoder-only large language models (LLMs) excel in high-resource languages across various tasks through few-shot or even zero-shot in-context learning (ICL). However, their perform…

cs.CL2024

TransMI: A Framework to Create Strong Baselines from Multilingual Pretrained Language Models for Transliterated Data

Yihong Liu, Chunlan Ma, Haotian Ye +1

Transliterating related languages that use different scripts into a common script is effective for improving crosslingual transfer in downstream tasks. However, this methodology of…