1 citations · 1 across the 6 of their papers we have counts for
6 papers
The Initialization Determines Whether In-Context Learning Is Gradient Descent
Shifeng Xie, Rui Yuan, Simone Rossi +1
In-context learning (ICL) in large language models (LLMs) is a striking phenomenon, yet its underlying mechanisms remain only partially understood. Previous work connects linear se…
From predictions to confidence intervals: an empirical study of conformal prediction methods for in-context learning
Zhe Huang, Simone Rossi, Rui Yuan +1
Transformers have become a standard architecture in machine learning, demonstrating strong in-context learning (ICL) abilities that allow them to learn from the prompt at inference…
Think2SQL: Reinforce LLM Reasoning Capabilities for Text2SQL
Simone Papicchio, Simone Rossi, Luca Cagliero +1
Large Language Models (LLMs) can translate natural language into SQL, but small models struggle with multi-table and complex queries in Zero-Shot Learning (ZSL) settings. While Sup…
Optimizing Diffusion Models for Joint Trajectory Prediction and Controllable Generation
Yixiao Wang, Chen Tang, Lingfeng Sun +8
Diffusion models are promising for joint trajectory prediction and controllable generation in autonomous driving, but they face challenges of inefficient inference steps and high c…
Class Balanced Dynamic Acquisition for Domain Adaptive Semantic Segmentation using Active Learning
Marc Schachtsiek, Simone Rossi, Thomas Hannagan
Domain adaptive active learning is leading the charge in label-efficient training of neural networks. For semantic segmentation, state-of-the-art models jointly use two criteria of…
On permutation symmetries in Bayesian neural network posteriors: a variational perspective
Simone Rossi, Ankit Singh, Thomas Hannagan
The elusive nature of gradient-based optimization in neural networks is tied to their loss landscape geometry, which is poorly understood. However recent work has brought solid evi…