Achieving Productivity Gains with AI-based IDE features: A Journey at Google

Abstract

We discuss Google's journey in developing and refining two internal AI-based IDE features: code completion and natural-language-driven code transformation (Transform Code). We address challenges in latency, user experience and suggestion quality, all backed by rigorous experimentation. The article serves as an example of how to refine AI developer tools across the user interface, backend, and model layers, to deliver tangible productivity improvements in an enterprise setting.

Accepted for publication at the 3rd International Workshop on Large Language Models For Code (LLM4Code '26 workshop at ICSE '26)