5 papers
No Need to Train Your RDB Foundation Model
Linjie Xu, Yanlin Zhang, Quan Gan +2
Relational databases (RDBs) contain vast amounts of heterogeneous tabular information that can be exploited for predictive modeling purposes. But since the space of potential targe…
ABLE: Representing and Mapping LLMs via Attribution-Based Large-model Embedding
Zirui Wang, Yusen Hou, Shaofeng Liang +4
The explosive growth of large language models (LLMs) has created a heterogeneous and poorly documented ecosystem, making systematic model comparison increasingly important for prov…
CHARM: Calibrating Reward Models With Chatbot Arena Scores
Xiao Zhu, Chenmien Tan, Pinzhen Chen +4
Reward models (RMs) play a crucial role in Reinforcement Learning from Human Feedback by serving as proxies for human preferences in aligning large language models. However, they s…
RDBLearn: Simple In-Context Prediction Over Relational Databases
Yanlin Zhang, Linjie Xu, Quan Gan +2
Recent advances in tabular in-context learning (ICL) show that a single pretrained model can adapt to new prediction tasks from a small set of labeled examples, avoiding per-task t…
ELF-Gym: Evaluating Large Language Models Generated Features for Tabular Prediction
Yanlin Zhang, Ning Li, Quan Gan +3
Crafting effective features is a crucial yet labor-intensive and domain-specific task within machine learning pipelines. Fortunately, recent advancements in Large Language Models (…