69 citations · 99 across the 18 of their papers we have counts for
19 papers
Cross-Lingual Transfer for Machine Translation in Turkic Languages
Omer Burak Cinar, Mehmet Mert Dalkilic, Cagri Toraman
Cross-lingual transfer is central to low-resource machine translation, but its behavior within closely related language families remains insufficiently characterized. We study tran…
OCRTurk: A Comprehensive OCR Benchmark for Turkish
Deniz Yılmaz, Evren Ayberk Munis, Çağrı Toraman +4
Document parsing is now widely used in applications, such as large-scale document digitization, retrieval-augmented generation, and domain-specific pipelines in healthcare and educ…
RAGTurk: Best Practices for Retrieval Augmented Generation in Turkish
Süha Kağan Köse, Mehmet Can Baytekin, Burak Aktaş +5
Retrieval-Augmented Generation (RAG) enhances LLM factuality, yet design guidance remains English-centric, limiting insights for morphologically rich languages like Turkish. We add…
BIRDTurk: Adaptation of the BIRD Text-to-SQL Dataset to Turkish
Burak Aktaş, Mehmet Can Baytekin, Süha Kağan Köse +4
Text-to-SQL systems have achieved strong performance on English benchmarks, yet their behavior in morphologically rich, low-resource languages remains largely unexplored. We introd…
TurkBench: A Benchmark for Evaluating Turkish Large Language Models
Çağrı Toraman, Ahmet Kaan Sever, Ayse Aysu Cengiz +19
With the recent surge in the development of large language models, the need for comprehensive and language-specific evaluation benchmarks has become critical. While significant pro…
FIBER: A Multilingual Evaluation Resource for Factual Inference Bias
Evren Ayberk Munis, Deniz Yılmaz, Arianna Muti +1
Large language models are widely used across domains, yet there are concerns about their factual reliability and biases. Factual knowledge probing offers a systematic means to eval…
OpenEthics: A Comprehensive Ethical Evaluation of Open-Source Generative Large Language Models
Yıldırım Özen, Burak Erinç Çetin, Kaan Engür +2
Generative large language models present significant potential but also raise critical ethical concerns, including issues of safety, fairness, robustness, and reliability. Most exi…
Evaluating the Quality of Benchmark Datasets for Low-Resource Languages: A Case Study on Turkish
Ayşe Aysu Cengiz, Ahmet Kaan Sever, Elif Ecem Ümütlü +6
The reliance on translated or adapted datasets from English or multilingual resources introduces challenges regarding linguistic and cultural suitability. This study addresses the…
LlamaTurk: Adapting Open-Source Generative Large Language Models for Low-Resource Language
Cagri Toraman
Despite advancements in English-dominant generative large language models, further development is needed for low-resource languages to enhance global accessibility. The primary met…
PejorativITy: Disambiguating Pejorative Epithets to Improve Misogyny Detection in Italian Tweets
Arianna Muti, Federico Ruggeri, Cagri Toraman +6
Misogyny is often expressed through figurative language. Some neutral words can assume a negative connotation when functioning as pejorative epithets. Disambiguating the meaning of…
ARC-NLP at PAN 2023: Transition-Focused Natural Language Inference for Writing Style Detection
Izzet Emre Kucukkaya, Umitcan Sahin, Cagri Toraman
The task of multi-author writing style detection aims at finding any positions of writing style change in a given text document. We formulate the task as a natural language inferen…
ARC-NLP at PAN 2023: Hierarchical Long Text Classification for Trigger Detection
Umitcan Sahin, Izzet Emre Kucukkaya, Cagri Toraman
Fanfiction, a popular form of creative writing set within established fictional universes, has gained a substantial online following. However, ensuring the well-being and safety of…
ARC-NLP at Multimodal Hate Speech Event Detection 2023: Multimodal Methods Boosted by Ensemble Learning, Syntactical and Entity Features
Umitcan Sahin, Izzet Emre Kucukkaya, Oguzhan Ozcelik +1
Text-embedded images can serve as a means of spreading hate speech, propaganda, and extremist beliefs. Throughout the Russia-Ukraine war, both opposing factions heavily relied on t…
Tweets Under the Rubble: Detection of Messages Calling for Help in Earthquake Disaster
Cagri Toraman, Izzet Emre Kucukkaya, Oguzhan Ozcelik +1
The importance of social media is again exposed in the recent tragedy of the 2023 Turkey and Syria earthquake. Many victims who were trapped under the rubble called for help by pos…
MiDe22: An Annotated Multi-Event Tweet Dataset for Misinformation Detection
Cagri Toraman, Oguzhan Ozcelik, Furkan Şahinuç +1
The rapid dissemination of misinformation through online social networks poses a pressing issue with harmful consequences jeopardizing human health, public safety, democracy, and t…
Impact of Tokenization on Language Models: An Analysis for Turkish
Cagri Toraman, Eyup Halit Yilmaz, Furkan Şahinuç +1
Tokenization is an important text preprocessing step to prepare input tokens for deep language models. WordPiece and BPE are de facto methods employed by important models, such as…
Large-Scale Hate Speech Detection with Cross-Domain Transfer
Cagri Toraman, Furkan Şahinuç, Eyup Halit Yilmaz
The performance of hate speech detection models relies on the datasets on which the models are trained. Existing datasets are mostly prepared with a limited number of instances or…
BlackLivesMatter 2020: An Analysis of Deleted and Suspended Users in Twitter
Cagri Toraman, Furkan Şahinuç, Eyup Halit Yilmaz
After George Floyd's death in May 2020, the volume of discussion in social media increased dramatically. A series of protests followed this tragic event, called as the 2020 BlackLi…
ConQX: Semantic Expansion of Spoken Queries for Intent Detection based on Conditioned Text Generation
Eyup Halit Yilmaz, Cagri Toraman
Intent detection of spoken queries is a challenging task due to their noisy structure and short length. To provide additional information regarding the query and enhance the perfor…