most citedGemini 1.5: Unlocking multimodal understanding across millions of tokens of context

297 citations · 300 across the 6 of their papers we have counts for

collaborators

6 papers

cs.CL2024

FLEURS-ASL: Including American Sign Language in Massively Multilingual Multitask Evaluation

Garrett Tanzer

Sign language translation has historically been peripheral to mainstream machine translation research. In order to help converge the fields, we introduce FLEURS-ASL, an extension o…

cs.CV2024

FSboard: Over 3 million characters of ASL fingerspelling collected via smartphones

Manfred Georg, Garrett Tanzer, Saad Hassan +5

Progress in machine understanding of sign languages has been slow and hampered by limited data. In this paper, we present FSboard, an American Sign Language fingerspelling dataset…

cs.CL2024

Scaling Sign Language Translation

Biao Zhang, Garrett Tanzer, Orhan Firat

Sign language translation (SLT) addresses the problem of translating information from a sign language in video to a spoken language in text. Existing studies, while showing progres…

cs.CL2024★ 2 cited

YouTube-SL-25: A Large-Scale, Open-Domain Multilingual Sign Language Parallel Corpus

Garrett Tanzer, Biao Zhang

Even for better-studied sign languages like American Sign Language (ASL), data is the bottleneck for machine learning research. The situation is worse yet for the many other sign l…

cs.CV2024★ 1 cited

DOCCI: Descriptions of Connected and Contrasting Images

Yasumasa Onoe, Sunayana Rane, Zachary Berger +9

Vision-language datasets are vital for both text-to-image (T2I) and image-to-text (I2T) research. However, current datasets lack descriptions with fine-grained detail that would al…

cs.CL2024★ 297 cited

Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context

Gemini Team, Petko Georgiev, Ving Ian Lei +1132

In this report, we introduce the Gemini 1.5 family of models, representing the next generation of highly compute-efficient multimodal models capable of recalling and reasoning over…