Relative Information

For four decades, information theory has been viewed almost exclusively as a theory based upon the Shannon measure of uncertainty and information, usually referred to as Shannon entropy. Since its inception in 1948, the Shannon theory has been viewed as a restricted information theory.