Evaluating perturbation robustness of generative systems that use COBOL code inputs

Samuel Ackerman, Wesam Ibraheem, Orna Raz +1

Systems incorporating large language models (LLMs) as a component are known to be sensitive (i.e., non-robust) to minor input variations that do not change the meaning of the input…