1 citations · 2 across the 13 of their papers we have counts for
14 papers
Can Transformers Really Do It All? On the Compatibility of Inductive Biases Across Tasks
Damien Teney, Liangze Jiang, Hemanth Saratchandran +1
Transformers are remarkably versatile and their design is largely consistent across a variety of applications. But are they optimal for any given task or dataset? The answer may be…
Multi-Hypothesis Test-Time Adaptation to Mitigate Underspecification
Afshar Shamsi, Xiao-Yu Guo, Hamid Alinejad-Rokny +3
Test-Time Adaptation (TTA) seeks to improve model robustness under distribution shifts by adapting parameters using unlabeled target data. However, in the absence of supervision, e…
Meta-RL Induces Exploration in Language Agents
Yulun Jiang, Liangze Jiang, Damien Teney +2
Reinforcement learning (RL) has enabled the training of large language model (LLM) agents to interact with the environment and to solve multi-turn long-horizon tasks. However, the…
Mysteries of the Deep: Role of Intermediate Representations in Out of Distribution Detection
I. M. De la Jara, C. Rodriguez-Opazo, D. Teney +2
Out-of-distribution (OOD) detection is essential for reliably deploying machine learning models in the wild. Yet, most methods treat large pre-trained models as monolithic encoders…
How does the optimizer implicitly bias the model merging loss landscape?
Chenxiang Zhang, Alexander Theus, Damien Teney +3
Model merging combines independent solutions with different capabilities into a single one while maintaining the same inference cost. Two popular approaches are linear interpolatio…
Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild
Damien Teney, Liangze Jiang, Florin Gogianu +1
Neural architectures tend to fit their data with relatively simple functions. This "simplicity bias" is widely regarded as key to their success. This paper explores the limits of t…
AugGen: Synthetic Augmentation using Diffusion Models Can Improve Recognition
Parsa Rahimi, Damien Teney, Sebastien Marcel
The increasing reliance on large-scale datasets in machine learning poses significant privacy and ethical challenges, particularly in sensitive domains such as face recognition. Sy…
OOD-Chameleon: Is Algorithm Selection for OOD Generalization Learnable?
Liangze Jiang, Damien Teney
Out-of-distribution (OOD) generalization is challenging because distribution shifts come in many forms. Numerous algorithms exist to address specific settings, but choosing the rig…
Scalable Ensemble Diversification for OOD Generalization and Detection
Alexander Rubinstein, Luca Scimeca, Damien Teney +1
Training a diverse ensemble of models has several practical applications such as providing candidates for model selection with better out-of-distribution (OOD) generalization, and…
CulturePark: Boosting Cross-cultural Understanding in Large Language Models
Cheng Li, Damien Teney, Linyi Yang +3
Cultural bias is pervasive in many large language models (LLMs), largely due to the deficiency of data representative of different cultures. Typically, cultural datasets and benchm…
Neural Redshift: Random Networks are not Random Functions
Damien Teney, Armand Nicolicioiu, Valentin Hartmann +1
Our understanding of the generalization capabilities of neural networks (NNs) is still incomplete. Prevailing explanations are based on implicit biases of gradient descent (GD) but…
Leveraging Diffusion Disentangled Representations to Mitigate Shortcuts in Underspecified Visual Tasks
Luca Scimeca, Alexander Rubinstein, Armand Mihai Nicolicioiu +2
Spurious correlations in the data, where multiple cues are predictive of the target labels, often lead to shortcut learning phenomena, where a model may rely on erroneous, easy-to-…
Mitigating Shortcut Learning with Diffusion Counterfactuals and Diverse Ensembles
Luca Scimeca, Alexander Rubinstein, Damien Teney +2
Spurious correlations in the data, where multiple cues are predictive of the target labels, often lead to a phenomenon known as shortcut learning, where a model relies on erroneous…
ZooPFL: Exploring Black-box Foundation Models for Personalized Federated Learning
Wang Lu, Hao Yu, Jindong Wang +6
When personalized federated learning (FL) meets large foundation models, new challenges arise from various limitations in resources. In addition to typical limitations such as data…