[ EE 376A :: Information Theory ]

Announcements

[2009/03/20] Class grades viewable on Axess within a day if not already. Exam grades viewable on eeclass.
[2009/03/20] Final Exam and Solutions to Final Exam are available.
[2009/03/20] Graded Exams may be picked up from Denise Murphy on the 2nd floor of Packard.
[2009/03/09] The Final Examination will be from 3:30 to 6:30 pm on Monday, March 16th in Kresge Auditorium. Open book, open notes.
[2009/03/13] Final Exam Review Session Notes are now available here.
[2009/03/13] Midterm Review Session Notes have been available here.
[2009/03/13] Final Exam Review Session will be held on Friday 3/13, in Packard 036 from 4PM to 6PM (actually 7PM and terminated by student request).
[2009/03/09] Last chance to check your grades on eeclass. Especially your Homework 8 grade! Also, please fill out the TA evaluation form on eeclass if you could; I would appreciate it.
[2009/03/09] Practice final examination and solutions are now available.
[2009/03/09] The last topics you are responsible for are sections 9.1 and 9.2 of the text. Rate distortion will be covered in EE376B, which Thomas Cover will also teach in the Spring.
[2009/03/09] Handout available: "About Claude Shannon".
[2009/02/27] Homework 8, the last homework, has been posted. Due Tuesday, March 10, 2009.
[2009/02/19] Midterms returned. Solutions available.
- Average = 172.25 out of 190.
- Standard Deviation = 15.85.
- Total Number of Examinees: 54.
[2009/02/15] Solutions to Homework 5 have been posted. PS format will no longer be supported; let me know if this is a problem for you.
[2009/02/14] The in-class Midterm will be on Tuesday, February 17th during the lecture period in class. Open book, open notes.
[2009/02/14] Notes from midterm review session have beeen posted. Fixed some typos, and included more pictures.
[2009/02/14] Two practice midterms posted.
[2009/02/12] A midterm review session by William Wu will be held on Friday, 2/13, in Packard 036 from 4:30 to 6:30 PM.
[2009/02/12] A midterm review session by Lei Zhao will be held on Thursday, 2/12, in Packard 036 from 4:30 to 5:30 PM.
[2009/01/22] In Problem 3 of HW 2, assume that X, Q1, and Q2 are all jointly independent.
[2009/01/15] Important: If you are enrolled in the course, please make an account for yourself at eeclass -- this is needed so we can input your homework grades. About 20 people still haven't signed up!
[2009/01/13] William Wu's office hours changed just for this week: W 3-4 PM, in Packard 277.
[2009/01/12] For quals takers only, HW1 due Fri 5PM.
[2009/01/11] Direct e-mails about the course to ee376a-win0809-staff@lists.stanford.edu. This way, any of the staff can potentially help you out.
[2009/01/11] Website redesigned by [wu].
[2009/01/09] All grader positions taken.
[2009/01/08] Random number analysis posted.
[2009/01/06] Welcome to EE376A!

Course Description

Extreme points of communication theory: data compression to the entropy limit, and communication at the channel capacity limit. Shannon entropy. Rate distortion theory. Huffman coding. Kolmogorov complexity. Unified treatment based on the asymptotic equipartition theorem.

Lectures

380-380C, TTh 11-12:15pm, 3 Units.

The Course Outline shows what Professor Cover will cover in each lecture ths quarter.

Exams

The in-class Midterm will be on Tuesday, February 17th during the lecture period. Open book, open notes.
The Final Exam will be from 3:30 to 6:30 pm on Monday, March 16th in Kresge Auditorium. Open book, open notes.

Teaching Staff

Instructor:

Professor Thomas Cover: Office: Packard 254; Email: cover@stanford.edu; Phone: 650-723-4505

Teaching Assistants:

Main TA: William Wu
Office: Packard 268

E-mail: willywu@stanford.edu

Phone: 650-736-1300

Lei Zhao
Office: Packard 251

E-mail: leiz@stanford.edu

Phone: 650-723-4544

Paul Cuff
Office: Packard 251

E-mail: pcuff@stanford.edu

Phone: 650-723-4544

Office Hours:

Professor Thomas Cover
Time: W 2-3 PM

Place: Packard 254

Generally available mid-afternoons.
William Wu
Time: W 4-5 PM

Place: Packard 277

(If not there, check Packard 268.)

Administrative Associate:

Denise Murphy

Office: Packard 267

Tel: 650-723-4731

Fax: 650-724-6487

Email: denise@ee.stanford.edu

Textbook

Elements of Information Theory by Cover and Thomas, 2nd Edition, New York: Wiley, 2006.

Prerequisites

You should have seen some probability at the level of EE 178 or STAT 116 or equivalent.

EE 376A / STAT 376A Information Theory, Winter 08-09