Separating Prompt Harmfulness from Interaction Safety via Partial Generation

Ram Vikas Mishra, Shashank Aggarwal, Jahnavi Kumar +1

LLM-based information systems need safety guardrails. Most guardrails classify the prompt alone. If the prompt looks harmful, the system rejects it before any answer is generated.…