most citedWhen Every Token Counts: Optimal Segmentation for Low-Resource Language Models

1 citations · 1 across the 8 of their papers we have counts for

collaborators

9 papers

cs.AI2025

ScheduleMe: Multi-Agent Calendar Assistant

Oshadha Wijerathne, Amandi Nimasha, Dushan Fernando +2

Recent advancements in LLMs have contributed to the rise of advanced conversational assistants that can assist with user needs through natural language conversation. This paper pre…

cs.CR2025

XOXO: Stealthy Cross-Origin Context Poisoning Attacks against AI Coding Assistants

Adam Štorek, Mukur Gupta, Noopur Bhatt +4

AI coding assistants are widely used for tasks like code generation. These tools now require large and complex contexts, automatically sourced from various origins$\unicode{x2014}$…

cs.CL2025

DebateBench: A Challenging Long Context Reasoning Benchmark For Large Language Models

Utkarsh Tiwari, Aryan Seth, Adi Mukherjee +3

We introduce DebateBench, a novel dataset consisting of an extensive collection of transcripts and metadata from some of the world's most prestigious competitive debates. The datas…

cs.CL2025

ARISE: Iterative Rule Induction and Synthetic Data Generation for Text Classification

Yashwanth M., Vaibhav Singh, Ayush Maheshwari +2

We propose ARISE, a framework that iteratively induces rules and generates synthetic data for text classification. We combine synthetic data generation and automatic rule induction…

cs.RO2024

RLDG: Robotic Generalist Policy Distillation via Reinforcement Learning

Charles Xu, Qiyang Li, Jianlan Luo +1

Recent advances in robotic foundation models have enabled the development of generalist policies that can adapt to diverse tasks. While these models show impressive flexibility, th…

cs.CL2024★ 1 cited

When Every Token Counts: Optimal Segmentation for Low-Resource Language Models

Bharath Raj, Garvit Suri, Vikrant Dewangan +1

Traditional greedy tokenization methods have been a critical step in Natural Language Processing (NLP), influencing how text is converted into tokens and directly impacting model p…

cs.CL2024

Seed-Free Synthetic Data Generation Framework for Instruction-Tuning LLMs: A Case Study in Thai

Parinthapat Pengpun, Can Udomcharoenchaikit, Weerayut Buaphet +1

We present a synthetic data approach for instruction-tuning large language models (LLMs) for low-resource languages in a data-efficient manner, specifically focusing on Thai. We id…

cs.CV2024

VISTA: A Visual and Textual Attention Dataset for Interpreting Multimodal Models

Harshit, Tolga Tasdizen

The recent developments in deep learning led to the integration of natural language processing (NLP) with computer vision, resulting in powerful integrated Vision and Language Mode…

cs.CL2024

Losing Visual Needles in Image Haystacks: Vision Language Models are Easily Distracted in Short and Long Contexts

Aditya Sharma, Michael Saxon, William Yang Wang

We present LoCoVQA, a dynamic benchmark generator for evaluating long-context extractive reasoning in vision language models (VLMs). LoCoVQA augments test examples for mathematical…