Collection

Beyond usage: what AI actually does

Experiments, payroll data and spending records that measure outcomes, not whether people say they use AI.

Most AI surveys ask whether companies use AI. These reports measure what happens when they do: controlled experiments on productivity, hiring and job data, what companies actually spend, and what goes wrong. Start with the experiments, then the labor data, then the money.

Reading list

  1. 01METR · Jul 2025Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer ProductivityA randomized trial: experienced developers were slower with AI but believed they were faster.
  2. 02NBER · Feb 2026Does Generative AI Narrow Education-Based Productivity Gaps? Evidence from a Randomized ExperimentAn experiment where AI narrowed the gap between less- and more-educated workers.
  3. 03Faros AI · Jul 2025The AI Productivity Paradox Report 2025Telemetry from engineering teams: more output per person, no company-level gain.
  4. 04DX · Jul 2026State of AI Impact in Engineering: Q2 2026 ReportAI writes half the code, but time on new features hasn't moved.
  5. 05CAIS · Oct 2025Remote Labor Index: Measuring AI Automation of Remote WorkHow often AI agents can finish real paid freelance projects.
  6. 06NBER · Feb 2026Firm Data on AI (NBER Working Paper 34836)Executives report wide use but little productivity effect so far.
  7. 07Stanford DEL · Aug 2026Canaries in the Coal Mine? Six Facts about the Recent Employment Effects of Artificial IntelligencePayroll data on early-career workers in AI-exposed jobs.
  8. 08Harvard · Aug 2025Generative AI as Seniority-Biased Technological Change: Evidence from U.S. Résumé and Job Posting DataJunior hiring at firms that adopted generative AI.
  9. 09Yale Budget Lab · Jul 2026Tracking the Impact of AI on the Labor MarketA running check on whether AI is reshaping the job mix yet.
  10. 10New York Fed · Sep 2026Businesses Are Using AI to Transform Work, Not Cut JobsHow many AI-using firms have actually cut or added staff.
  11. 11Ramp · Jun 2026A New Look at AI's Impact on Jobs: Firm-Level AI Spending and Workforce AdjustmentFirms that spend most on AI grew headcount faster.
  12. 12Challenger · Oct 2026Challenger Report: September Layoff Plans Fall to 43,281; Seasonal Hiring MutedAnnounced US job cuts that employers attribute to AI.
  13. 13Menlo Ventures · Dec 20252025: The State of Generative AI in the EnterpriseWhere enterprise AI budgets are going.
  14. 14Ramp · Sep 2026Ramp AI Index, September 2026: Cracks in the AI Thesis, Part 2Card and invoice data on what businesses actually pay for AI.
  15. 15Domino · Jul 2026The Fifth Annual Domino Enterprise AI ReportWhether returns are keeping pace with spend.
  16. 16IBM · Jul 2026Cost of a Data Breach Report 2026What AI-enabled breaches cost.
  17. 17Veracode · Jul 20262026 GenAI Code Security ReportHow often AI-written code passes security tests.