Publications (8)
H2OVL-Mississippi Vision Language Models Technical Report
Shaikat Galib, Shanshan Wang, Guanshuo Xu +4
Smaller vision-language models (VLMs) are becoming increasingly important for privacy-focused, on-device applications due to their ability to run efficiently on consumer hardware f…
H2O Open Ecosystem for State-of-the-art Large Language Models
Arno Candel, Jon McKinney, Philipp Singer +4
Large Language Models (LLMs) represent a revolution in AI. However, they also pose many significant risks, such as the presence of biased, private, copyrighted or harmful text. For…
Recognizing bird species in diverse soundscapes under weak supervision
Christof Henkel, Pascal Pfeiffer, Philipp Singer
We present a robust classification approach for avian vocalization in complex and diverse soundscapes, achieving second place in the BirdCLEF2021 challenge. We illustrate how to ma…
H2O-Danube3 Technical Report
Pascal Pfeiffer, Philipp Singer, Yauhen Babakhin +3
We present H2O-Danube3, a series of small language models consisting of H2O-Danube3-4B, trained on 6T tokens and H2O-Danube3-500M, trained on 4T tokens. Our models are pre-trained…
H2O-Danube-1.8B Technical Report
Philipp Singer, Pascal Pfeiffer, Yauhen Babakhin +4
We present H2O-Danube, a series of small 1.8B language models consisting of H2O-Danube-1.8B, trained on 1T tokens, and the incremental improved H2O-Danube2-1.8B trained on an addit…
TabH2O: A Unified Foundation Model for Tabular Prediction
Pascal Pfeiffer, Dmitry Gordeev, Mathias Müller +6
We present TabH2O, a foundation model for tabular data that performs classification and regression in a single forward pass via in-context learning. TabH2O builds on the TabICL arc…
h2oGPT: Democratizing Large Language Models
Arno Candel, Jon McKinney, Philipp Singer +12
Applications built on top of Large Language Models (LLMs) such as GPT-4 represent a revolution in AI due to their human-level capabilities in natural language processing. However,…
Corridor for new mobility Aachen-Düsseldorf: Methods and concepts of the research project ACCorD
Laurent Kloeker, Amarin Kloeker, Fabian Thomsen +11
With the Corridor for New Mobility Aachen - Düsseldorf, an integrated development environment is created, incorporating existing test capabilities, to systematically test and vali…