2004

Labeling Images With a Computer Game

Luis Von Ahn, Laura Dabbish

citations

Cite Score

64

AI summary

This paper introduces the "ESP game," an interactive system that leverages human desire for entertainment to label images on the Web, circumventing the limitations of computer vision and significantly improving image search, accessibility, and content filtering.

Main Contributions

  • Introduces the ESP game, a novel interactive system for image labeling that transforms tedious manual work into an enjoyable game.
  • Proposes a method for image labeling that harnesses human perceptual abilities and desire for entertainment, rather than relying on computer vision techniques.
  • Demonstrates the potential to label a vast number of web images (e.g., all images indexed by Google in 31 days with 5,000 continuous players).
  • Highlights applications for the generated labels in improving image search, accessibility for visually impaired individuals, and filtering inappropriate content.
  • Presents empirical evidence for the game's popularity and the high quality of the labels produced through various evaluation methods, including search precision and human assessment.

Abstract

We introduce a new interactive system: a game that is fun and can be used to create valuable output. When people play the game they help determine the contents of images by providing meaningful labels for them. If the game is played as much as popular online games, we estimate that most images on the Web can be labeled in a few months. Having proper labels associated with each image on the Web would allow for more accurate image search, improve the accessibility of sites (by providing descriptions of images to visually impaired individuals), and help users block inappropriate images. Our system makes a significant contribution because of its valuable output and because of the way it addresses the image-labeling problem. Rather than using computer vision techniques, which don't work well enough, we encourage people to do the work by taking advantage of their desire to be entertained.

Citation Graph

Loading graph...

References [21]

Sort:
Filter:

P. Duygulu, K. Barnard, N. D. Freitas, D. A. Forsyth - 2002

2 papers in library cite

D. G. Stork - 1999

2 papers in library cite

Missing year

A. Company

1 paper in library cites

B. O'connor, M. O'connor - 1999

1 paper in library cites

K. Barnard, P. Duygulu, D. A. Forsyth - 2001

1 paper in library cites

M. M. Fleck, D. A. Forsyth, C. Bregler - 1996

1 paper in library cites

Missing year

G. Inc

1 paper in library cites

R. L. Trask - 1994

1 paper in library cites

K. Barnard, D. A. Forsyth - 2001

1 paper in library cites

Missing year

M. Corporation

1 paper in library cites

Missing year

I. N2h2

1 paper in library cites

H. Scheniderman, Takeo Kanade - 2002

1 paper in library cites

D. G. Stork, C. P. Lam - 2000

1 paper in library cites

Missing year

R. Lempel, A. Soffer

1 paper in library cites

Missing year

E. Arts

1 paper in library cites

Missing year

R. B. M. Website

1 paper in library cites

Missing year

Corbis

1 paper in library cites

C. Carson, V. E. Ogle - 1996

1 paper in library cites

Missing year

C. U. C. F. T. Research

1 paper in library cites

Missing year

R. E. Milliman

1 paper in library cites

Missing year

I. Yahoo!

1 paper in library cites

Cited by

5

papers in your library

Cites

0

papers in your library

Read

on January 11, 2026

Your review

Tags

Paper Aliases

No aliases