3 papers
Speedrunning Relational Foundation Model Pretraining
Gabriel Wedson Mendonça de Souza Veloso, Luan Borges Teodoro Reis Sena, Denis Oliveira Correa +1
Progress on foundation model pretraining is gated by who can afford a trial, and relational pretraining is no exception. Recipes are developed inside individual labs, reported unde…
Context Window Failures in Relational Foundation Models
Denis Oliveira Correa, Francisco Galuppo Azevedo
Recent Relational Deep Learning architectures have been proposed as foundation models for multi-table relational data, yet they impose constrained neighborhood budgets that force r…
Task Scarcity and Label Leakage in Relational Transfer Learning
Francisco Galuppo Azevedo, Clarissa Lima Loures, Denis Oliveira Correa
Training relational foundation models requires learning representations that transfer across tasks, yet available supervision is typically limited to a small number of prediction t…