2 papers
cs.CL2026
What Single-Prompt Accuracy Misses: A Multi-Variant Reliability Audit of Language Models
Ranit Karmakar, Jayita Chatterjee
Single-prompt accuracy is the dominant way to benchmark language models, but it can miss reliability failures that matter. We evaluate a 15-model open-weight corpus, with the main…
cs.AI2026
AgentFloor: How Far Up the tool use Ladder Can Small Open-Weight Models Go?
Ranit Karmakar, Jayita Chatterjee
Production agentic systems make many model calls per user request, and most of those calls are short, structured, and routine. This raises a practical routing question that existin…