Agent Effectiveness

How well engineers use AI coding agents, whether sessions ship, what each outcome costs, and how deep each session goes.

• Agent Effectiveness Score How do we measure whether our engineers are using AI coding agents effectively, and where do we need to invest in training rather than better tools?
• Outcome Success What percentage of AI coding agent sessions in our engineering organization actually result in code that gets merged, and what's driving the sessions that don't?
• Cost per Outcome How do we calculate the true cost per unit of engineering output from AI coding agents, and how does that cost vary across the different tools our team uses?
• Session Depth How deeply are our engineers engaging with AI coding agents in each session, and what does session depth tell us about proficiency versus unproductive looping?