Publications (22)
TabPFN-3: Technical Report
Léo Grinsztajn, Klemens Flöge, Oscar Key +38
Tabular data underpins most high-value prediction problems in science and industry, and TabPFN has driven the foundation model revolution for this modality. Designed with feedback…
H2O Open Ecosystem for State-of-the-art Large Language Models
Arno Candel, Jon McKinney, Philipp Singer +4
Large Language Models (LLMs) represent a revolution in AI. However, they also pose many significant risks, such as the presence of biased, private, copyrighted or harmful text. For…
H2O-Danube3 Technical Report
Pascal Pfeiffer, Philipp Singer, Yauhen Babakhin +3
We present H2O-Danube3, a series of small language models consisting of H2O-Danube3-4B, trained on 6T tokens and H2O-Danube3-500M, trained on 4T tokens. Our models are pre-trained…
Discovering and Characterizing Mobility Patterns in Urban Spaces: A Study of Manhattan Taxi Data
Lisette EspÃn-Noboa, Florian Lemmerich, Philipp Singer +1
Nowadays, human movement in urban spaces can be traced digitally in many cases. It can be observed that movement patterns are not constant, but vary across time and space. In this…
H2O-Danube-1.8B Technical Report
Philipp Singer, Pascal Pfeiffer, Yauhen Babakhin +4
We present H2O-Danube, a series of small 1.8B language models consisting of H2O-Danube-1.8B, trained on 1T tokens, and the incremental improved H2O-Danube2-1.8B trained on an addit…
Sampling from Social Networks with Attributes
Claudia Wagner, Philipp Singer, Fariba Karimi +2
Sampling from large networks represents a fundamental challenge for social network research. In this paper, we explore the sensitivity of different sampling techniques (node sampli…
MixedTrails: Bayesian hypothesis comparison on heterogeneous sequential data
Martin Becker, Florian Lemmerich, Philipp Singer +2
Sequential traces of user data are frequently observed online and offline, e.g., as sequences of visited websites or as sequences of locations captured by GPS. However, understandi…
Discovering Beaten Paths in Collaborative Ontology-Engineering Projects using Markov Chains
Simon Walk, Philipp Singer, Markus Strohmaier +3
Biomedical taxonomies, thesauri and ontologies in the form of the International Classification of Diseases (ICD) as a taxonomy or the National Cancer Institute Thesaurus as an OWL-…
Backtesting the predictability of COVID-19
Dmitry Gordeev, Philipp Singer, Marios Michailidis +2
The advent of the COVID-19 pandemic has instigated unprecedented changes in many countries around the globe, putting a significant burden on the health sectors, affecting the macro…
Supporting large-scale image recognition with out-of-domain samples
Christof Henkel, Philipp Singer
This article presents an efficient end-to-end method to perform instance-level recognition employed to the task of labeling and ranking landmark images. In a first step, we embed i…
Semantic Stability in Social Tagging Streams
Claudia Wagner, Philipp Singer, Markus Strohmaier +1
One potential disadvantage of social tagging systems is that due to the lack of a centralized vocabulary, a crowd of users may never manage to reach a consensus on the description…
Recognizing bird species in diverse soundscapes under weak supervision
Christof Henkel, Pascal Pfeiffer, Philipp Singer
We present a robust classification approach for avian vocalization in complex and diverse soundscapes, achieving second place in the BirdCLEF2021 challenge. We illustrate how to ma…
Why We Read Wikipedia
Philipp Singer, Florian Lemmerich, Robert West +4
Wikipedia is one of the most popular sites on the Web, with millions of users relying on it to satisfy a broad range of information needs every day. Although it is crucial to under…
What Makes a Link Successful on Wikipedia?
Dimitar Dimitrov, Philipp Singer, Florian Lemmerich +1
While a plethora of hypertext links exist on the Web, only a small amount of them are regularly clicked. Starting from this observation, we set out to study large-scale click data…
Evolution of Reddit: From the Front Page of the Internet to a Self-referential Community?
Philipp Singer, Fabian Flöck, Clemens Meinhart +2
In the past few years, Reddit -- a community-driven platform for submitting, commenting and rating links and text posts -- has grown exponentially, from a small community of users…
Evidence of Online Performance Deterioration in User Sessions on Reddit
Philipp Singer, Emilio Ferrara, Farshad Kooti +2
This article presents evidence of performance deterioration in online user sessions quantified by studying a massive dataset containing over 55 million comments posted on Reddit in…
Detecting Memory and Structure in Human Navigation Patterns Using Markov Chain Models of Varying Order
Philipp Singer, Denis Helic, Behnam Taraghi +1
One of the most frequently used models for understanding human navigation on the Web is the Markov chain model, where Web pages are represented as states and hyperlinks as probabil…
How to Apply Markov Chains for Modeling Sequential Edit Patterns in Collaborative Ontology-Engineering Projects
Simon Walk, Philipp Singer, Markus Strohmaier +3
With the growing popularity of large-scale collaborative ontology-engineering projects, such as the creation of the 11th revision of the International Classification of Diseases, w…
Of course we share! Testing Assumptions about Social Tagging Systems
Stephan Doerfel, Daniel Zoller, Philipp Singer +3
Social tagging systems have established themselves as an important part in today's web and have attracted the interest from our research community in a variety of investigations. T…
HypTrails: A Bayesian Approach for Comparing Hypotheses About Human Trails on the Web
Philipp Singer, Denis Helic, Andreas Hotho +1
When users interact with the Web today, they leave sequential digital trails on a massive scale. Examples of such human trails include Web navigation, sequences of online restauran…
h2oGPT: Democratizing Large Language Models
Arno Candel, Jon McKinney, Philipp Singer +12
Applications built on top of Large Language Models (LLMs) such as GPT-4 represent a revolution in AI due to their human-level capabilities in natural language processing. However,…
Visibility of minorities in social networks
Fariba Karimi, Mathieu Génois, Claudia Wagner +2
Homophily can put minority groups at a disadvantage by restricting their ability to establish links with people from a majority group. This can limit the overall visibility of mino…