1968

Logical Basis for Information Theory and Probability Theory

Andrei N. Kolmogorov

citations

Cite Score

33

AI summary

This paper proposes a new logical basis for information theory and probability theory using computing complexity, redefining concepts like entropy and mutual information to apply to individual values rather than only to random ones.

Main Contributions

  • Proposes a new logical basis for information theory and probability theory based on computing complexity.
  • Redefines the concept of entropy H(x|y) as the minimal length of a program to construct x given y.
  • Argues that information theory concepts can be applied to individual values, not just random ones.
  • Suggests that randomness can be defined as the absence of periodicity.
  • Introduces formulas for information and entropy that incorporate logarithmic-order terms, showing them as approximate equalities rather than exact ones.

Abstract

A new logical basis for information theory as well as probability theory is proposed, based on computing complexity.

Citation Graph

Loading graph...

References [9]

Sort:
Filter:

D. Loveland - 1966

1 paper in library cites

P. M. Lof - 1966

1 paper in library cites

D. Loveland - 1966

1 paper in library cites

R. J. Solomonov - 1964

1 paper in library cites

A. Kolmogorov - 1963

1 paper in library cites

A. Church - 1940

1 paper in library cites

S. J. Chaitin - 1966

1 paper in library cites

P. M. Lof - 1966

1 paper in library cites

A. Kolmogorov - 1965

1 paper in library cites

Cited by

1

papers in your library

Cites

0

papers in your library

Read

on January 18, 2026

Your review

Tags

Paper Aliases

No aliases