Claude Shannon published 'A Mathematical Theory of Communication' in the Bell System Technical Journal, establishing the field of information theory. His groundbreaking work introduced concepts like information entropy, channel capacity, and the bit as a unit of information, providing the mathematical foundation for digital communications. Shannon's theory became essential to computing, data compression, and eventually the development of large language models.