Entropy in Information Theory is the measure of information in terms of uncertainty
= Number of binary questions we have to ask to determine the state
Intro to Information Theory | Digital Communication | Information Technology - YouTube
Information Theory & Coding - Professor Brailsford - Computerphile - YouTube