1989

Backpropagation Applied to Handwritten Zip-Code Recognition

Yann Lecun, B. Boser, John S. Denker, D. Henderson, R. E. Howard, W. Hubbard, L. D. Jackal

citations

Cite Score

91

AI summary

This paper introduces a neural network architecture using backpropagation for handwritten zip code recognition, achieving state-of-the-art results on a dataset of 9298 segmented numerals. The model integrates constraints through its architecture, demonstrating the ability of backpropagation networks to handle large amounts of low-level information.

Main Contributions

  • Successfully applied backpropagation learning to a real-world task of handwritten zip code recognition.
  • Developed a network architecture with constraints to incorporate geometric knowledge, resulting in improved generalization.
  • Demonstrated that the learning time was relatively short due to the redundant nature of the data and the imposed constraints.
  • Achieved state-of-the-art results in digit recognition with the trained network.
  • Showed that the final network can be readily implemented on commercial digital signal processing hardware.

Abstract

The ability of learning networks to generalize can be greatly enhanced by providing constraints from the task domain. This paper demonstrates how such constraints can be integrated into a backpropagation network through the architecture of the network. This approach has been successfully applied to the recognition of handwritten zip code digits provided by the U.S. Postal Service. A single network learns the entire recognition operation, going from the normalized image of the character to the final classification.

Citation Graph

Loading graph...

References [15]

Sort:
Filter:

D. E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams - 1986

46 papers in library cite

Yann Lecun - 1989

5 papers in library cite

S. Becker, Yann Lecun - 1988

9 papers in library cite

John Denker, Daniel Schwartz, Ben Wittner, Sara A. Solla, Richard Howard, Lawrence Jackel, John Hopfield - 1987

4 papers in library cite

I. Guyon - 1989

2 papers in library cite

Yann Lecun - 1987

9 papers in library cite

D. H. Hubel, T. N. Wiesel - 1962

8 papers in library cite

L. Y. Bottou, Yann Lecun - 1988

5 papers in library cite

S. Patarnello, P. Carnevali - 1987

3 papers in library cite

E. B. Baum, D. Haussler - 1989

3 papers in library cite

N. Tishby, E. Levin, Sara A. Solla - 1989

2 papers in library cite

M. C. Mozer - 1987

1 paper in library cites

Cited by

24

papers in your library

Cites

6

papers in your library

Read

on June 22, 2025

Your review

Tags

Paper Aliases

No aliases