Influence of Prompt Engineering on Small Language Models for Guarded Query Routing

Richard Šléher, William Brach, Kristián Košťál +1

We study the problem of guarded query routing, where we assume that a user query first meets a router that either determines the ideal endpoint for in-distribution queries or rejec…