Information Theory SubjectInformationEntropyQuantum InformationCryptographyInformation scienceLandauer's principleComplexity Theory Information theoryInformation theory is the mathematical study of the quantification, storage, and communication of information.[1] The field was originally established by the works of Harry Nyquist and Ralph Hartley, in the 1920s, and Claude Shannon in the 1940s.[2]: vii  The field is at the intersection of probability theory, statistics, computer science, statistical mechanics, information engineering, and electrical engineering.https://en.wikipedia.org/wiki/Information_theory초보를 위한 정보이론 안내서 - Entropy란 무엇일까딥러닝을 공부하다 보면 KL-divergence, cross-entropy 등에서 entropy라는 용어를 자주 접하게 됩니다. 이번 글을 통해서 정보이론의 아버지라 불리는 Shannon이 주창한 기초 개념인 entropy를 정리해봅니다.https://skywalker023.github.io/blog/2017/10/14/Entropy.html6. Infomation Theoryhttp://norman3.github.io/prml/docs/chapter01/6
