information theory

noun

1. the mathematical theory concerned with the content, transmission, storage, and retrieval of information, usually in the form of messages or data, and especially by means of computers.

information theory

noun

1. a collection of mathematical theories, based on statistics, concerned with methods of coding, transmitting, storing, retrieving, and decoding information

information theory

1. A branch of mathematics that mathematically defines and analyzes the concept of information. Information theory involves statistics and probability theory, and applications include the design of systems that have to do with data transmission, encryption, compression, and other information processing.

Word History and Origins

Origin of information theory¹

First recorded in 1945–50

Example Sentences

"With Gašper's expertise in information theory, we were able to put it together," Brückner adds excitedly.

From Science Daily

With diffusion models, an iterative data generation process starts from basic noise, a concept used in information theory to mimic the effect of many random processes that occur in nature.

From Science Daily

In September, over 100 consciousness researchers signed a public letter condemning one of the most popular theories of consciousness—the integrated information theory—as pseudoscience.

From Scientific American

In my recent research, published in AIP Advances, I used information theory to propose a new law of physics, which I call the second law of infodynamics.

From Salon

This approach is computationally quite difficult, but the team incorporated recent information theory advances to find a near-optimal choice quickly.

From Scientific American