5 citations · 5 across the 8 of their papers we have counts for
12 papers
CIDER-FM: Foundation Models for Causal Inference from Diverse Experimental Regimes
Yuche Gao, Arik Reuter, Siyuan Guo +3
Causal foundation models (CFMs) amortise causal inference over priors of synthetic structural causal models (SCMs), predicting the effect of an experiment on a specific variable. H…
Advancing Open and Reproducible Relational Learning: RelArena-, TabPFN-Rel and RPI
Adrian Hayler, Klemens Flöge, Alan Arazi +44
This first release of Prior Labs in relational learning shows our continued commitment to open science. We open-source three pieces of software that we expect to accelerate researc…
On the Emergence and Test-Time Use of Structural Information in Large Language Models
Michelle Chao Chen, Moritz Miller, Bernhard Schölkopf +1
Learning structural information from observational data is central to producing new knowledge outside the training corpus. This holds for mechanistic understanding in scientific di…
Hausdorff measure of cartesian product of Cantor sets
Siyuan Guo, Taylor Jones
Hausdorff measure and Hausdorff dimension are useful tools to describe fractals. This paper investigates the bounds on the -dimensional Hausdorff measure of the -fold…
Physics of Learning: A Lagrangian perspective to different learning paradigms
Siyuan Guo, Bernhard Schölkopf
We study the problem of building an efficient learning system. Efficient learning processes information in the least time, i.e., building a system that reaches a desired error thre…
Skill Learning via Policy Diversity Yields Identifiable Representations for Reinforcement Learning
Patrik Reizinger, Bálint Mucsányi, Siyuan Guo +3
Self-supervised feature learning and pretraining methods in reinforcement learning (RL) often rely on information-theoretic principles, termed mutual information skill learning (MI…
Do-PFN: In-Context Learning for Causal Effect Estimation
Jake Robertson, Arik Reuter, Siyuan Guo +3
Estimation of causal effects is critical to a range of scientific disciplines. Existing methods for this task either require interventional data, knowledge about the ground truth c…
Counterfactual reasoning: an analysis of in-context emergence
Moritz Miller, Bernhard Schölkopf, Siyuan Guo
Large-scale neural language models exhibit remarkable performance in in-context learning: the ability to learn and reason about the input context on the fly. This work studies in-c…
Identifiable Exchangeable Mechanisms for Causal Structure and Representation Learning
Patrik Reizinger, Siyuan Guo, Ferenc Huszár +2
Identifying latent representations or causal structures is important for good generalization and downstream task performance. However, both fields have been developed rather indepe…
Do Finetti: On Causal Effects for Exchangeable Data
Siyuan Guo, Chi Zhang, Karthika Mohan +2
We study causal effect estimation in a setting where the data are not i.i.d. (independent and identically distributed). We focus on exchangeable data satisfying an assumption of in…
Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs
Siyuan Guo, Aniket Didolkar, Nan Rosemary Ke +3
We are beginning to see progress in language model assisted scientific discovery. Motivated by the use of LLMs as a general scientific assistant, this paper assesses the domain kno…
Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving
Aniket Didolkar, Anirudh Goyal, Nan Rosemary Ke +7
Metacognitive knowledge refers to humans' intuitive knowledge of their own thinking and reasoning processes. Today's best LLMs clearly possess some reasoning processes. The paper g…