1996

Sequential Neural Text Compression

Jürgen Schmidhuber

citations

Cite Score

8

AI summary

This paper introduces a neural text compression method combining predictive neural networks and statistical coding techniques, surpassing Lempel-Ziv algorithms on newspaper articles, but with significantly slower processing speed, demonstrating the potential of neural networks in data compression.

Main Contributions

  • Introduces a new approach to text compression using predictive neural networks and statistical coding.
  • Combines neural nets with Huffman-Coding, Arithmetic Coding and variants of the principle of history compression
  • Presents three off-line methods for text compression and decompression using the trained predictor network.
  • Achieves compression ratios exceeding those of widely used Lempel-Ziv algorithms on short newspaper articles.
  • Demonstrates the potential of neural networks for loss-free data compression, although with slower processing speed compared to standard methods.

Abstract

The purpose of this paper is to show that neural networks are promising tools for data compression without loss of information. We combine predictive neural nets and statistical coding techniques to compress text files. We apply our methods to short newspaper articles and obtain compression ratios exceeding those of widely used Lempel-Ziv algorithms (which build the basis of the UNIX functions "compress" and "gzip"). The main disadvantage of our methods is that they are three orders of magnitude slower than standard methods.

Citation Graph

Loading graph...

References [13]

Sort:
Filter:

D. E. Rumelhart, Geoffrey E. Hinton, Ronald J. Williams - 1986

46 papers in library cite

P. Werbos - 1974

14 papers in library cite

Jürgen Schmidhuber - 1992

8 papers in library cite

J. H. Schmidhuber - 1992

2 papers in library cite

Jürgen Schmidhuber - 1992

2 papers in library cite

J. Ziv, A. Lempel - 1977

1 paper in library cites

I. H. Witten, Radford M. Neal, J. G. Cleary - 1987

1 paper in library cites

S. Lindstadt, M. C. Mozer, P. Smolensky, D. S. Touretzky, Jeffrey L. Elman, A. S. Weigend - 1993

1 paper in library cites

J. H. Schmidhuber, M. C. Mozer, D. Prelinger, H. Huning, S. Neuhauser, M. Raus, W. Ritschel - 1993

1 paper in library cites

G. Held - 1991

1 paper in library cites

J. H. Schmidhuber, D. Prelinger - 1993

1 paper in library cites

A. Wyner, J. Ziv - 1991

1 paper in library cites

T. C. Bell, J. G. Cleary, I. H. Witten - 1990

1 paper in library cites

Cited by

3

papers in your library

Cites

2

papers in your library

Read

on June 23, 2025

Your review

Tags

Paper Aliases

No aliases