CS240: Advanced Topics in Operating Systems

Spring 2003 -- Dawson Engler

Class Abstract

Students will study advanced operating system topics and be exposed to recent developments in operating systems research. This course involves readings and lectures on classic and new papers. Topics: virtual memory management, synchronization and communication, file systems, protection and security, operating system structure and extension techniques, fault tolerance, and history and experience of systems programming.

Quiz 3

Quiz 3 is available here( PDF ) for SITN students. It is an open book exam. You have 50 minutes to complete it. Please send in your answers using the SITN courier service. Solution Explanation for the last question.

Quiz 2

Quiz 2 is available here( PDF ) for SITN students. It is an open book exam. You have 50 minutes to complete it. Please send in your answers using the SITN courier service. Solution

Quiz 1

Quiz 1 is available here( PDF) for SITN students. It is an open book exam. You have 50 minutes to complete it. Please send in your answers using the SITN courier service. Solution

Class Times

Section 1: MWF 1:15-2:05 in Terman 102
Section 2: MWF 2:15-3:05 in McCull 115
(You may choose which section you wish to attend.)

Course Staff

Instructor

Dawson Engler
Office: 314 Gates
Telephone: (650) 723-0762
E-mail: engler@cs.stanford.edu
Office hours: By appointment

Teaching Assistant

Dapeng Zhu
Office: 440 Gates
Telephone: (650) 723-9437
E-mail: dapengz@Stanford.EDU
Office hours: 3:30pm - 5:30pm Monday and Wednesday. Extra office hours before exams

Course Secretary

Pamela Elliot
Office: 303 Gates
Phone: (650) 725-3726
E-mail: pamela@csl.stanford.edu

Mailing List

There is a mailing list for contacting the staff: cs240-spr0203-staff@lists.stanford.edu. Questions and comments should be sent there. Please prefix the subject line with "CS240" for a prompt response. Announcements from the staff will be sent via the cs240-spr0203-students@lists.stanford.edu mailing list to which any registered student will automatically be added to. If you are not registered for the class then subscribe to the cs240-spr0203-guests mailing list by emailing majordomo@lists.stanford.edu with the body of the message saying "subscribe cs240-spr0203-guests."

Prerequisites

The prerequisite for this class is CS 140 (previously CS 240A) or the equivalent. It is necessary to have this background before taking the class, as we'll read a lot papers quickly without much time for catching up on the basics. The course assumes an understanding of topics in operating systems such as synchronization, virtual memory management, scheduling, and file systems.

The other requirement is that students be able to send and receive email, access the class newsgroup, access the class web page, and download and print postscript from the class web page. There will be very few handouts in the course, since most of the notes and other materials will be available only on the class web page.

Course Organization and Workload

The course consists of lectures, readings, and three exams. As the quarter progresses there may be ways to get extra credit. The two most important things to know about the class: (1) the main goal is to have interesting in-class discussions and (2) we recommend you read each paper at least twice, preferably more than a day in advance so that it sinks in.

Most of the work in this course consists of reading journal and conference papers. We will cover one paper for each class meeting. Unlike past quarters this class will be primarily discussion based, rather than organized as lectures. Active discussion will (hopefully) give you a non-trivial understanding of the material. The only way this approach can work is if you read the papers carefully. To encourage this, 40% of your class grade will come from class participation ( except for SITN students, whose grades are determined by the exams only ): this includes talking in class, as well as how you do on pop quizzes and (possibly) pop presentations. Class time will not be used to rehash the material in the papers. Instead, it will be used to highlight the important points and discuss some of the more interesting features. There will be as much as 10-15 hours of reading per week. Do not take this course unless you are willing and able to do a lot of reading.

Readings

There is no textbook for this course. The course is based on a collection of journal and conference papers that describe the history and state of the art in operating systems. Papers will be discussed in class in approximately the order that they appear on the reading list. You must read the papers before class. At a minimum we recommend two close readings. We will provide most papers online; those that are only available in hardcopy will be provided about a week before they are needed.

Grading Policy

The class is graded on a rough curve with an average grade being a B+. 40% of your grade will come from class participation, the other 60% will be based on the two midterm exam scores and the final exam score. All three exams count. Note this is different from previous quarter's grading policy where only the best two exams count. Because of the experimental nature of the course, the grading will not be very strict. 100% of the SITN students' grades will be based on the exams.

Exams

Two midterm exams and a final exam will be given in class. They will be open book . The midterm exams are not cumulative, but the final exam is cumulative. A sample exam will be available along with sample solutions. Review sessions will be held before each exam.

Sample Exams

The sample exams are from past midterms and they contain questions from papers that will not be covered this quarter. You can ignore these questions.
  1. Winter Quarter 2003 Quiz 1     We did not cover Question 9 and 10.
  2. Spring Quarter 2002 Quiz 2     We did not cover Question 1, 5, 9 and 10.
  3. Winter Quarter 2003 Quiz 2     We did not cover Question 2, 6, 8 and 10.
  4. Spring Quarter 2002 Quiz 3    
  5. Winter Quarter 2003 Quiz 3    
  6. Sample midterm 1     We did not cover the XFS paper.
  7. Sample midterm 2     Contains a couple of Flash questions.
  8. Sample midterm 3     We did not cover the duality paper.

Newsgroup

There is a class newsgroup, su.class.cs240, that can be used by members of the class to converse with each other. All course announcements will be put on to the class web page. The news group is a good place to advertise for study groups, ask questions of other students, etc.

Course Outline

This course makes no attempt to cover all the interesting topics in operating systems. Instead, we will cover a few topics in depth. The course is divided into the following general topic areas:

Virtual memory management
Discussions of virtual memory management implementations and recent work in virtual memory for multiprocessors, NUMA machines, large virtual address spaces, and other topics.
Synchronization and communication
Discussions of synchronization with an emphasis on monitors. Communication using remote procedure call.
File systems
Discussions of file system interfaces and disk storage management techniques.
Protection and security
Discussions of data security and authentication.
Extensions and fault tolerance
Discussions of mechanisms for implementing OS services at user level, OS structure and performance, reliability and availability of OS services.
History and experience
Historically important papers and experience reports by senior researchers in the field.

Reading List

Category/Date Title Author(s)
(4/2) The Rise of "Worse is Better" Richard Gabriel
Conc. (4/4) An Investigation of the Therac-25 Accidents Leveson and Turner
Conc. (4/7) Eraser: A Dynamic Data Race Detector for Multithreaded Programs Stefan Savage
Conc. (4/9) Experience with Processes and Monitors in Mesa Butler Lampson
Conc. (4/11) On the Duality of Operating System Structures Hugh C. Lauer and Roger M. Needham
VM (4/14) Virtual Memory Management in the VAX/VMS Operating System Levy and Lipman
VM (4/16) Practical, Transparent, Operating System Support for Superpages Navarro, Iyer, Druschel, and Cox
VM (4/18) Memory Resource Management in VMware ESX Server Waldspurger
(4/21) Efficient Software-Based Fault Isolation Wahbe et al.
N/W (4/28) Flash: An Efficient and Portable Web Server Pai, Druschel, and Zwaenepoel
N/W (4/30) Eliminating Receive Livelock in an Interrupt-Driven Kernel Mogul and Ramakrishnan
N/W (5/2) The End to End Argument in System Design Saltzer, Reed, Clark NOTE: this replaces "Experiences with a High-Speed Network Adaptor: A Software Perspective"
(5/5) Virtualizing I/O Devices on VMWare Workstation's Hosted Virtual Machine Monitor Sugerman, Venkitachalam and Lim
(5/7) Design and Implementation of the SUN Network Filesystem Sandberg et al.
(5/9) Time, Clocks and the Ordering of Events in a Distributed System Leslie Lamport
Leases: An Efficient Fault-Tolerant Mechanism for Distributed File Cache Consistency Gray and Cheriton
FS (5/12) A Low-Bandwidth Network File System Muthitacharoen, Chen, and Mazieres
FS (5/19) The Anatomy of a Large-Scale Hypertextual Web Search Engine Brin and Page
FS (5/21) The Design and Implementation of a Log-Structured File System Rosenblum and Ousterhout
FS (5/23) A Case for Redundant Arrays of Inexpensive Disks (RAID) Patterson, Gibson, and Katz
(5/30) Checking System Rules Using System-Specific, Programmer-Written Compiler Extensions Engler, Chelf, Chou, Hallem
Experience (6/2) The Cathedral and the Bazaar Raymond

Class Websites from Previous Quarters


Webpage maintained by Dapeng Zhu
Last updated 06/09/03