AI Engineering Playbook

Comparisons › Published results and metrics

Published results and metrics

Every company-reported or press-reported result of AI adoption in engineering in the database, with sources.

42 companies. Claims are quoted or paraphrased from the linked sources; check the source date, because policies change.

CompanyIndustry / sizeWhat the sources say
Airbnb
Mandate: unclear
Travel / marketplace
5k-50k employees
  • Airbnb migrated nearly 3.5K test files from Enzyme to React Testing Library in 6 weeks. It had estimated the work at 1.5 years by hand. The first bulk run migrated 75% of files in four hours, and the pipeline reached 97% before the rest were finished manually. (Airbnb Tech, 2025-03; InfoQ, 2025-03-28)
  • Chesky said teams are shipping more features and iterating more quickly as a result. (Motley Fool, 2026-05-07)
  • Airbnb compared the migration's duration with an estimate of how long it would take by hand, and tracked the share of files migrated per run. (Airbnb Tech, 2025-03)
  • Brian Chesky said on the Q1 2026 call that nearly 60% of the code Airbnb engineers produce is now written by AI, which he estimated at about twice the industry average. (TechCrunch, 2026-05-08; Motley Fool, 2026-05-07)
Alibaba
Mandate: unclear
Big tech (China)
50k+ employees
Amazon
Mandate: unclear
Big tech
50k+ employees
  • Amazon says Amazon Q Developer helped it migrate tens of thousands of production apps from Java 8/11 to Java 17. It puts the savings at more than 4,500 developer-years and $260M a year. (AWS DevOps Blog, 2024-08-01)
  • AI Teammate, a Slack-integrated agent, has expanded to 700+ active teams, and some groups, including parts of AWS, have adopted Pippin (ideas to technical designs) more broadly. (Business Insider, 2026-04-27)
  • Amazon estimated time saved from the number of Java dependencies migrated, and cost savings from hosts removed after the Java 17 upgrades. (AWS DevOps Blog, 2024-08-01)
  • A February 2026 internal document asked 2,100+ Stores engineering teams to triple release velocity, with at least 25 teams aiming for 10x, and set a goal of 80% of teams on AI-native practices (about 60% were at the time). (Business Insider, 2026-04-27)
  • Tracked metrics include monthly active users, NPS, a 'Value Deriving Event' and deployments per engineer per week. The document flags Goodhart's Law as a risk. (Business Insider, 2026-04-27)
AMD
Mandate: unclear
Semiconductors / AI
5k-50k employees
Anthropic
Mandate: unclear
AI lab
Under 5k employees
  • Respondents self-reported using Claude in 59% of their work, for a +50% productivity gain. Anthropic saw a 67% increase in merged PRs per engineer per day after adopting Claude Code. (Anthropic, 2025-12-02)
  • Claude Code went from about 9.8 consecutive tool calls per transcript to 21.2, and human turns fell from 6.2 to 4.1. (Anthropic, 2025-12-02)
  • Employees raised concerns about skill atrophy and reduced mentorship. (Anthropic, 2025-12-02)
  • Head of platform engineering Katelyn Lesse said in October 2026 that Claude writes 'literally all' of her team's code, while people still design systems and verifications. (Business Insider, 2026-10-22)
  • Superseded (2025 survey): staff now say Claude-written code went from worse than human code in late 2025 to roughly at parity by mid-2026. (Anthropic Institute, 2026-06-04)
  • Anthropic surveyed 132 engineers and researchers, interviewed 53, and analyzed 200,000 internal Claude Code transcripts (August 2025). (Anthropic, 2025-12-02)
  • As of May 2026, more than 80% of code merged into Anthropic's codebase was attributed to Claude, up from low single digits before February 2025. Leadership estimates 90%+ including scripts. (Anthropic Institute, 2026-06-04)
  • The typical engineer merged about 8x as much code per day in Q2 2026 as in 2024. Anthropic says lines of code overstate the true gain. (Anthropic Institute, 2026-06-04)
Apple
Mandate: unclear
Big tech
50k+ employees
  • Apple's Support app version 5.13 shipped with internal CLAUDE.md files (Claude Code project instructions), which were removed in the next update. (Yahoo Tech, 2026-05-01)
Atlassian
Mandate: unclear
Enterprise SaaS
5k-50k employees
  • Atlassian reports a 30.8% reduction in median PR cycle time and 35.6% fewer human review comments across 1,900+ repos. (Atlassian, 2026-04-07)
  • AI review comments were resolved 38.7% of the time, versus 44.45% for human comments. (Atlassian, 2026-04-07)
  • Atlassian measures median PR cycle time, human review comments per PR, and the resolution rate of AI comments versus human comments. (Atlassian, 2026-04-07)
Block
Mandate: unclear
Fintech / payments
5k-50k employees
  • Block reports that about 95% of engineers regularly use AI. Within three months of the Champions program, AI-authored code rose 69%, time savings rose 37%, and automated PRs grew 21x. (Block Engineering, 2026-01-18)
  • Block tracks AI's contribution through PR labels and Co-authored-by attribution, and measures time savings and automated PRs. (Block Engineering, 2026-01-18)
Box
Mandate: unclear
Enterprise SaaS
Under 5k employees
  • Box says it ideated over 100 AI agents across every function, then focused on a few 'big bets' to roll out at scale across 2,800 employees. (Box blog, 2025-09-04)
  • Per Cursor's case study, 800+ developers (85% of engineering) use Cursor daily, Levie estimates a 30-50% roadmap throughput increase, and React and design-system migrations finished 80-90% faster than expected. (Cursor customer story, 2026-02-13)
  • Cursor's case study reports Box's impact as product-roadmap throughput and migration effort. (Cursor customer story, 2026-02-13)
ByteDance
Mandate: unclear
Big tech (China)
50k+ employees
  • The TRAE team had more than 90% of its code written by AI over six months, but per-person throughput rose only 1.6x, which ByteDance cites as evidence that code share is a misleading metric. (163.com (IT Times), 2026-06-24)
  • Over the past year, AI's code contribution rate grew more than 6x, AI-coding token use 5x, and the AI-code merge rate more than 2x. (163.com (IT Times), 2026-06-24)
  • TRAE is used by 92% of ByteDance engineers. (Longbridge, 2025-12-18)
Canva
Mandate: unclear
Design / SaaS
5k-50k employees
  • Humphreys said agents deliver 'hours and hours' of work done autonomously. (Business Insider, 2026-02-15)
  • Superseded (June 2025): ACS reported that almost half of Canva's frontend and backend engineers use AI coding tools daily. (ACS Information Age, 2025-06-13)
  • Canva says nine in ten employees use AI every week. Forge, an internal tool for managing parallel AI agents, has 475 monthly active users and is now supported DevX tooling. (Canva Newsroom, 2026-05-19)
Cloudflare
Mandate: unclear
Cloud / networking
5k-50k employees
  • The average AI review costs $1.19 (median $0.98, P99 $4.45) and completes in a median of about 3 minutes 39 seconds. (Cloudflare blog, 2026-04-20)
  • 93% of Cloudflare R&D used AI coding tools, and 3,683 users (about 60% of the company) used them overall; 241.37 billion tokens went through AI Gateway. (Cloudflare blog, 2026-04-20)
  • Weekly merge requests rose from about 5,600 to more than 8,700, peaking at 10,952 in the week of March 23. (Cloudflare blog, 2026-04-20)
Databricks
Mandate: unclear
Data / cloud platform
5k-50k employees
  • The agent harness mattered as much as the model: one harness (Pi) was about 2x cheaper for similar results. (Databricks blog, 2026-07-08)
  • Agent verification time fell from about two weeks to hours with coSTAR. (Databricks blog, 2026-03-20)
  • On an internal benchmark built from merged PRs in its multi-million-line codebase, GLM 5.2 tied Claude Opus 4.8 at $1.28 versus $1.94 per task, and Databricks deployed it as a daily driver. (Databricks blog, 2026-07-08)
Datadog
Mandate: unclear
Observability / SaaS
5k-50k employees
  • An internal tool (Helix) was built in days with Claude Code. (Claude, 2026-07-21)
  • BitsEvolve, an LLM-guided optimizer, shipped 10x speedups on key ingestion functions, verified against live traffic. (Datadog blog, 2026-03-09)
  • All Datadog engineers use AI tools for production code, and Claude Code drives at least two-thirds of that use, according to Anthropic. (Claude, 2026-07-21)
  • Codex reviews every PR in one major repository, used by more than 1,000 engineers, according to OpenAI. (OpenAI, 2026-01-09)
Dropbox
Mandate: unclear
SaaS / cloud storage
Under 5k employees
  • More than 90% of Dropbox engineering uses AI tools. Copilot adoption sat in the low double digits from late 2023 through 2024, until leadership alignment and a change-management plan. (Dropbox.tech, 2025-08-19)
  • Nova accounts for roughly 1 in 12 pull requests at Dropbox (May 2026). It handles flaky-test fixes validated with 100+ CI runs, migrations and dependency upgrades. (Dropbox.tech, 2026-05-21; Dropbox.tech, 2026-05-28)
  • Dropbox evaluates AI tools on developer velocity and developer-experience sentiment, and tracks and shares adoption metrics. (Dropbox.tech, 2025-08-19)
  • Dropbox uses a four-stage model (Fuel, Adoption, Output, Impact) and tracks review turnaround, first-run test pass rate, defect ratio and rework rate. (Dropbox.tech, 2026-05-28)
Fiverr
Mandate: unclear
Marketplace
Under 5k employees
GitHub
Mandate: unclear
Developer tools
Under 5k employees
  • GitHub uptime fell below 85% in April 2026, and a merge-queue bug reverted code in 658 repositories, as agent traffic surged. (Times of India, 2026-05-05)
Google (Alphabet)
Mandate: unclear
Big tech
50k+ employees
  • Pichai said a complex code migration done by agents and engineers together finished six times faster than a comparable one a year earlier, and that engineers are moving to agentic workflows. (Google, 2026-04-22)
  • Superseded (October 2024): Pichai said more than a quarter of all new code at Google is AI-generated, then reviewed and accepted by engineers. (Google, 2024-10-29)
  • Pichai said in April 2026 that 75% of all new code at Google is AI-generated and approved by engineers, up from 50% the previous fall. (Google, 2026-04-22)
IBM
Mandate: unclear
Big tech
50k+ employees
  • The Instana team reports a 70% gain (about 10 hours a week per developer), and the Maximo team 69%. (IBM Newsroom, 2026-04-28)
  • IBM Bob is used by more than 80,000 IBM employees, who self-report an average 45% productivity gain. (IBM Newsroom, 2026-04-28)
  • CEO Arvind Krishna: 'We use agents and coding agents now for probably half the code that is written inside our place. And it is superior to what was written before.' (All-In podcast transcript, 2026-10-21)
Intercom
Mandate: yes
SaaS / customer service AI
Under 5k employees
LinkedIn
Mandate: unclear
Social / professional network
5k-50k employees
Mercado Libre
Mandate: unclear
E-commerce / fintech (LatAm)
50k+ employees
  • Superseded (2023): GitHub reported 9,000+ Mercado Libre developers using Copilot, with about a 50% reduction in time spent writing code. (GitHub customer story, 2023-05-23)
  • Management said product development costs fell from 8.4% to 7.2% of revenue, and pointed to AI productivity as a factor. (Motley Fool, 2026-08-12)
  • The case study reports time spent writing code and the number of developers using Copilot. (GitHub customer story, 2023-05-23)
  • On the Q2 2026 call management said 20,000 developers use AI and that 'human written code is the exception'; the majority of code is now written by AI. (Motley Fool, 2026-08-12)
Meta
Mandate: unclear
Big tech
50k+ employees
  • WIRED, citing other outlets' reporting, described a rise in bugs linked to reliance on AI-generated code. This is reported, not a company-published figure. (WIRED, 2026-09-02)
  • Individual AI usage metrics were not part of 2025 performance reviews, though employees were encouraged to cite AI wins. (Business Insider, 2025-11-14)
  • An employee-built internal AI-usage leaderboard was taken down after details leaked; Meta later told staff it would not use AI adoption dashboards or token counts to evaluate impact. (WIRED, 2026-09-02)
Netflix
Mandate: unclear
Consumer media
5k-50k employees
  • Netflix engineers became 20-30% more efficient with AI coding agents, and up to 65% on some tasks, according to JetBrains. (JetBrains, 2026-10-01)
  • More than 3,000 Netflix developers use Claude Code, tracked against a maturity ladder, according to a session at Anthropic's Code with Claude event. (Claude (Code with Claude SF), 2026-05-06)
Nvidia
Mandate: yes
Semiconductors / AI
5k-50k employees
OpenAI
Mandate: unclear
AI lab
5k-50k employees
  • The heaviest (99th-percentile) users run more than 60 hours of agent turns per day across parallel agents. (OpenAI, 2026-06-25)
  • Codex accounts for 99.8% of weekly output tokens inside OpenAI; the average engineer now generates 99% of output tokens with Codex, and engineering usage is 27x its November 2025 level. (OpenAI, 2026-06-25)
  • Codex writes nearly 80% of OpenAI's code, according to its India strategy head. (Outlook Business, 2026-05-15)
  • Codex writes more than 90% of the Codex app's own code; engineers typically run 4-8 agents in parallel. (The Pragmatic Engineer, 2026-02-17)
Ramp
Mandate: no
Fintech / spend management
Under 5k employees
Reddit
Mandate: unclear
Social media
Under 5k employees
  • Huffman: the bottleneck 'is actually code review' now that AI writes more code. (Livemint, 2026-03-22)
Robinhood
Mandate: unclear
Fintech / brokerage
Under 5k employees
  • Commits per engineer hit a new high in Q1 2026, up 50% since the start of 2025, which management attributed to AI tools. (Motley Fool, 2026-04-28)
  • Superseded (July 2025): CEO Vlad Tenev said close to 100% of engineers use AI code editors and about half of new code is AI-generated, a measurement he called imprecise. (Business Insider, 2025-07-17)
  • On the Q1 2026 call Robinhood said more than 90% of employees use AI tools and that it tracks commits per engineer deployed to production. (Motley Fool, 2026-04-28)
Salesforce
Mandate: unclear
Enterprise SaaS
50k+ employees
Samsung Electronics
Mandate: unclear
Electronics / semiconductors
50k+ employees
  • In the System LSI business, some tasks such as SoC verification and USB driver and emulator work went from weeks to days. (SamMobile, 2026-08-12)
  • More than 10,000 DS-division developers use Claude Code, starting from a pilot, an AWS speaker said at Samsung AI Forum 2026. (Digital Daily, 2026-09-30)
SAP
Mandate: unclear
Enterprise SaaS
50k+ employees
  • SAP reports about 20% efficiency gains in central functions from AI. (Motley Fool, 2026-10-22)
  • SAP developers completed approximately 70% more code contributions since the start of 2026, which CEO Christian Klein attributes to AI-first working principles. (Motley Fool, 2026-10-22)
ServiceNow
Mandate: unclear
Enterprise SaaS
5k-50k employees
Shopify
Mandate: yes
E-commerce
5k-50k employees
  • Shopify reports that its internal 'Quick' prototype-hosting sandbox has passed 5,000 sites since launching in mid-2025. (Shopify, 2025-10-28)
  • Every team has unlimited access to top AI models. (Shopify, 2025-10-28)
  • Engineering leadership estimates about a 20% productivity gain from AI tools. (BVP Atlas, 2026-04-02)
  • Shopify gave agents per-session remote dev environments, so agents run in parallel and overnight workflows fix bugs and open PRs. (Shopify Engineering, 2026-10-22)
  • Shopify said in October 2025 that it had hit universal adoption of AI code editors and was running thousands of Cursor licenses. (Shopify, 2025-10-28)
  • President Harley Finkelstein said on the Q1 2026 call that AI writes 'well over 50%' of Shopify's code and that the share is rising. (Motley Fool, 2026-05-05)
  • Shopify tracks code reversion rate, which it says has stayed roughly flat as AI use grew, and alerts on anyone spending more than $250 a day in tokens through its LLM proxy. (BVP Atlas, 2026-04-02)
  • In a 30-day window, River ran 59,918 sessions in 5,170 Slack channels and co-authored 3,536 merged pull requests (about one in eight merged PRs). (Shopify Engineering, 2026-05-28)
Snowflake
Mandate: unclear
Data / cloud platform
5k-50k employees
Spotify
Mandate: unclear
Consumer media
5k-50k employees
Stripe
Mandate: unclear
Fintech / payments
5k-50k employees
Tencent
Mandate: unclear
Big tech (China)
50k+ employees
Twilio
Mandate: unclear
Communications APIs
5k-50k employees
  • The docs generation pass took about 11 hours (about 35 seconds a page), versus an estimated two days per page by hand. (Twilio blog, 2026-09-17)
  • A product manager built more than 1,000 commits in 90 days with Claude Code, including 425 MCP tools, according to Anthropic. (Claude customer story, 2026-01-01)
  • CEO Khozema Shipchandler said employees achieved a 15% productivity boost with AI, used for coding, support and sales. (Business Insider, 2026-05-01)
Uber
Mandate: unclear
Mobility / marketplace
5k-50k employees
  • uReview analyzes over 90% of Uber's ~65,000 weekly diffs. Engineers mark 75% of its comments useful, and 65%+ are addressed, versus 51% for human comments. (Uber Engineering, 2025-08-12)
  • Uber estimates uReview saves about 1,500 hours each week, nearly 39 developer-years a year. (Uber Engineering, 2025-08-12)
  • Uber measures the usefulness rate (developer ratings), the share of comments addressed in the same changeset, and estimated review hours saved. (Uber Engineering, 2025-08-12)
  • CTO Praveen Neppalli Naga said in March 2026 that 95% of engineers use AI monthly, and that Uber's internal agent writes about 1,800 code changes a week entirely, up from under 1% to 8% of all changes. (Business Insider, 2026-03-18)
  • CEO Dara Khosrowshahi said in May 2026 that roughly 10% of code changes come from autonomous agents. (Business Insider, 2026-05-06)
Workday
Mandate: unclear
Enterprise SaaS
5k-50k employees
  • Workday says some key API development became about 30x faster. (Motley Fool, 2026-05-21)
  • 'More than 75% of our software engineers are using AI coding assistance and more than 50% of the committed code is AI generated.' (Motley Fool, 2026-05-21)
  • Engineering output grew 22% over six months, measured by the number of code updates. (Motley Fool, 2026-05-21)
Zapier
Mandate: yes
SaaS / automation
Under 5k employees
  • Zapier reports that 97% of employees use AI daily, and that developer productivity rose 11% in 2025 with Cursor, Claude Code and GitHub Copilot. (Zapier blog, 2025-07-30)
  • Zapier reports the share of employees using AI daily and changes in developer productivity. (Zapier blog, 2025-07-30)