Texonom
Texonom
/
Computing
Computing
/Computing Theory/
Information Theory
Search

Information Theory

Creator
Created
Created 2020 Mar 12 14:25
Editor
Edited
Edited 2023 Sep 9 16:34
Refs
Computability Theory
Information Theory Subject
Information
Entropy
Quantum Information
Cryptography
Information science
Landauer's principle
Complexity Theory
 
 
 
Information theory
Information theory is the mathematical study of the quantification, storage, and communication of information.[1] The field was originally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s.[2]: vii  The field is at the intersection of probability theory, statistics, computer science, statistical mechanics, information engineering, and electrical engineering.
Information theory
https://en.wikipedia.org/wiki/Information_theory
Information theory
초보를 위한 정보이론 안내서 - Entropy란 무엇일까
딥러닝을 공부하다 보면 KL-divergence, cross-entropy 등에서 entropy라는 용어를 자주 접하게 됩니다. 이번 글을 통해서 정보이론의 아버지라 불리는 Shannon이 주창한 기초 개념인 entropy를 정리해봅니다.
초보를 위한 정보이론 안내서 - Entropy란 무엇일까
https://skywalker023.github.io/blog/2017/10/14/Entropy.html
초보를 위한 정보이론 안내서 - Entropy란 무엇일까
6. Infomation Theory
6. Infomation Theory
http://norman3.github.io/prml/docs/chapter01/6
 
 

Texonom
Texonom
/
Computing
Computing
/Computing Theory/
Information Theory
Copyright Alan Jo