What Does an Observability Foundation Model Know?

Dhyey Dharmendrakumar Mavani, Rian Atri, Tairan Ji

A linear probe can show that a label is recoverable from a model's hidden states, but not whether that goes beyond what the input already reveals, or whether the model uses it. We…