Announcements
- [2009/06/08] Here is a practice final and solutions. Problem 1 can be ignored.
- [2009/06/08] Final exam is in normal classroom (Herrin T185) from 7-10pm tonight
- [2009/06/02] Solutions to problem set #8 are available online.
- [2009/06/02] Review session for final (by Paul Cuff) on Friday, June 5, from 3-4pm. Meet in Packard 251. Might move to conference room.
- [2009/04/16] Direct e-mails about the course to:
ee376b-spr0809-staff@lists.stanford.edu. This way any of the staff can potentially respond. - [2009/04/08] Next week only, office hours for Paul will be Wed. (4/15) instead of Tues.
- [2009/04/07] All grader positions taken.
- [2009/03/25] Welcome to EE376B!
Course Description
Extreme points of communication theory:
(Continuation of EE376A)
Differential entropy.
Maximum entropy.
Physics of information.
Gaussian channel, water filling.
Rate distortion theory.
Csiszar's method of types.
Information theory and statistics.
Large deviation theory.
Chernoff information.
Fisher information.
Universal source coding.
Lempel-Ziv.
Kolmogorov complexity and Chaitin's Ω.
Network information theory.
Broadcast, multiple access capacity, Slepian Wolf.
Portfolio theory.
AEP for ergodic processes.
Lectures
Herrin T185, TTh 11-12:15pm, 3 Units.
The lecture schedule shows what will likely be covered in each lecture this quarter.
Exams
- Final:
- June 8 (Monday), 7-10pm
- Herrin T185
- Practice final and solutions
Teaching Staff
- Instructor:
-
- Professor Thomas Cover
- Office: Packard 254
- Email: cover@stanford.edu
- Phone: 650-723-4505
- Teaching Assistants:
-
- Paul Cuff (Head TA)
- Office: Packard 251
- E-mail: cuff@stanford.edu
- Phone: 650-723-4544
- Lei Zhao
- Office: Packard 251
- E-mail: leiz@stanford.edu
- Phone: 650-723-4544
- Paul Cuff (Head TA)
- Office Hours:
-
- Professor Thomas Cover
- Time: W 2-3 PM
- Place: Packard 254
- Generally available mid-afternoons.
- Paul Cuff
- Time: T 1-2 PM
- Place: Packard 251
- Professor Thomas Cover
- Administrative Associate:
- Denise Murphy
- Office: Packard 267
- Tel: 650-723-4731
- Fax: 650-724-6487
- Email: denise@ee.stanford.edu
Textbook
Elements of Information Theory by Cover and Thomas, 2nd Edition, New York: Wiley, 2006.
Prerequisites
Help
In case you're using Internet Explorer and are not able to see the menu to the left, here are the links from the menu.