NovelAPIBench: Diagnosing How A Code LLM Learns to Use Novel APIs

Jinnuo Liu, Yue Peng, Jinhan Niu +1

Rapidly evolving software libraries require coding language models to use unfamiliar APIs. Yet failed solutions alone tell us little about what API knowledge models need or how to…