- EE/CS/IDS 160: Fundamentals of Information Transmission and Storage Winter 2020, Winter 2021
Basics of information theory : entropy, mutual information, source and channel coding theorems. Basics of coding theory: error-correcting codes for information transmission and storage, block codes, algebraic codes, sparse graph codes. Basics of digital communications: sampling, quantization, digital modulation, matched filters, equalization. - EE/CS/IDS 167: Introduction to Data Compression and Storage Spring 2017, Spring 2019
Prerequisites: Ma 3 or ACM/EE/IDS 116. The course will introduce the students to the basic principles and techniques of codes for data compression and storage. The students will master the basic algorithms used for lossless and lossy compression of digital and analog data and the major ideas behind coding for flash memories. Topics include the Huffman code, the arithmetic code, Lempel-Ziv dictionary techniques, scalar and vector quantizers, transform coding; codes for constrained storage systems. - EE/Ma/CS/IDS 127: Error-Correcting Codes Winter 2016, Winter 2017, Fall 2017, Winter 2019
This course develops from first principles the theory and practical implementation of the most important techniques for combating errors in digital transmission or storage systems. Topics include algebraic block codes, e.g., Hamming, BCH, Reed-Solomon (including a self-contained introduction to the theory of finite fields); and the modern theory of sparse graph codes with iterative decoding, e.g., LDPC codes, turbo codes. The students will become acquainted with encoding and decoding algorithms, design principles, and performance evaluation of codes. - EE/Ma/CS/IDS 136: Topics in Information Theory Spring 2016, Spring 2018
Prerequisites: Ma 3 or ACM/EE/IDS 116. This class introduces information measures such as entropy, information divergence, mutual information, information density from a probabilistic point of view, and discusses the relations of those quantities to problems in data compression and transmission, statistical inference, language modeling, game theory, and control. Topics include information projection, data processing inequalities, sufficient statistics, hypothesis testing, single-shot approach in information theory, large deviations. - EE 150: Nonasymptotic Information Theory Fall 2014
Prerequisites: EE/Ma 126. Delay-constrained theory of information: single-shot results, information spectrum methods. Information-theoretic limits for sources and channels with memory and/or general alphabets. Advantages of variable-length, feedback, and joint source-channel coding in the nonasymptotic regime. Error exponents, source, and channel dispersion.
