Local Optimality Does Not Compose: Invariant Simplices and the Complexity of Shared Probabilistic Automata
arXiv:2609.19707
Abstract
Probabilistic models are often constructed separately for different test suites and then expected to share a single latent dynamical system. We study bounded-state shared realization for probabilistic automata from finite partial trace specifications. A shared realization uses one normalized automaton with named initial distributions, a common family of row-stochastic letter-transition matrices, and one final output vector. We compare it with separate local realizations and a labelled query-specific static relaxation. Local and labelled query-specific static optima need not compose. For every , we construct finite partial specifications for which each individual specification and the labelled query-specific static relaxation have minimum state count , whereas every exact shared realization requires exactly states. The factor reflects the prefix progress that must be tracked by a single shared transition family. In the linear-rank-tight calibrated regime, the existence of an exact -state shared realization is equivalent to finding a -simplex containing the root responses, contained in the response polytope, and forward-invariant under every single-letter affine update. For finite rational specifications, exact shared realization with at most states is -complete, while distinguishing zero minimax defect from inverse-polynomial defect is -complete. Both classifications hold over a fixed five-letter alphabet when the local and labelled query-specific static optima already equal . They remain valid with Boolean final output vectors, and the robust gap persists over the full cube . Thus the hardness arises from shared word composition.