ai-labor-market

AI-Designed Games Beat Human Designers, Professionals Included

Buyers would pay $0.47 for games an AI designed alone and $0.37 for games people designed with the same tool. Professional designers lost too, and a "made by a human" label did not help.

VonHerausgeber und Autor
Veröffentlicht:
KI-gestützte Analyse

Players were willing to pay $0.47 on average to play a computer game an AI designed alone, and $0.37 for one a person designed with the same AI coding tool. Professional game developers, graphic designers and content creators lost to the AI too. A preregistered experiment by economists John Conlon (Ohio State) and Peter Schwardmann (Carnegie Mellon), posted to arXiv on October 12, 2026, tested two common reasons people give for why creative jobs will survive AI.

The setup

[Fact] Across three studies, 1,025 US participants recruited on Prolific between July and September 2026 produced or bought more than 1,600 small browser games. Producers started from a plain black-and-white game such as a Tetris or Pong clone and sent three rounds of instructions to a coding agent running Anthropic's Opus 4.8. Consumers stated how much they would pay to play the result instead of the basic game, and that amount was paid to the producer as a bonus. For the AI-only games, Anthropic's Sonnet 4.6 wrote a single design paragraph that went to the same coding agent, with no testing or revision.

Three findings

1. The AI designed better games. [Fact] In Study 1 the gap was 10 cents, or 0.31 standard deviations (p < 0.001). [Estimate] That makes the AI games worth about 27% more to buyers. [Fact] Games by the 180 professionals (51 in the video game industry, 70 graphic designers, 59 content creators) scored 0.16 standard deviations below the AI's. Buyers rated the AI games as more fun, more polished and more creative. The AI's design paragraphs averaged 235 words, against 89 words of combined instructions from professionals and 60 from amateurs.

2. Producers expected to win. [Fact] Before seeing the AI's idea, amateurs predicted the AI game would sell for 9 cents less than their own and professionals predicted 17 cents less. Their forecasts flipped once they read the AI's paragraph. [Estimate] Producers also overrated their own games: amateurs predicted an average price of $0.52 and received $0.37, an overshoot of about 41%, and professionals predicted $0.55 and received $0.35, about 57%.

3. A "made by a human" label did not help. [Fact] Telling buyers who made each game left the AI premium unchanged: 6.8 cents when buyers were not told and 6.0 cents when they were (p = 0.79 for the difference). Telling them their payment would go to the human producer made no difference either. Uninformed buyers could not tell the two apart, guessing a 59.3% chance that AI games were human-made and 58.2% for human games.

Watching the AI changed the producers

[Fact] Two-thirds of producers watched the AI design a game partway through. Their later games were rated more creative (p = 0.01) and more polished (p = 0.02), yet their pride in their own game fell by 0.14 standard deviations (p = 0.05). The job itself was valued: 80.7% were at least moderately proud of their game, and 92.1% were willing to pay to do the design task rather than skip it.

Which jobs this touches

[Claim] The authors expect the results to apply to creative work that sustains many mid-level jobs, and less clearly to superstar markets such as music or books. The closest matches are video game designers, graphic designers, special effects artists and animators and writers and authors who produce short commissioned work.

What to prepare

  • Test your forecast against the tool. Producers changed their minds only after reading the AI's idea. Running the same brief through an AI before quoting a job shows where your version actually stands.
  • Ask for more ideas than feels necessary. The AI's edge tracked the volume of ideas it produced. Generating several briefs and choosing among them is a habit people can copy.
  • Do not price on a human-made label. In this market, disclosure did not move what buyers paid.

Limits

Games lasted about a minute, prices were in cents, design took minutes with three edits, and participants were Prolific users who skew younger and more educated than the US population. The AI was deliberately handicapped (one prompt, no testing), which the authors say favours humans, but the result covers one product type. The paper is a working paper, not yet peer reviewed.

Sources

  • John J. Conlon and Peter Schwardmann, "Creative destruction: Human-AI competition in an experimental market", arXiv:2610.18921, October 12, 2026: https://arxiv.org/abs/2610.18921

About this analysis

This article was written with AI assistance, from the full text of the paper including its supplementary materials. The authors report no external funding and no competing interests; the experiment used Anthropic models. Figures marked [Estimate] (the 27% premium and the 41% and 57% overshoots) are our own arithmetic from the paper's numbers.

Analysis based on the Anthropic Economic Index, U.S. Bureau of Labor Statistics, and O*NET occupational data. Learn about our methodology

Aktualisierungsverlauf

  • Erstmals veröffentlicht am 17. Oktober 2026.
  • Keine wesentlichen Aktualisierungen seit der Erstveröffentlichung.

Tags

#arXiv#creative work#experiment#game design#human-made label#AI agents

Quellen

  1. arxiv.org