HY-559 Fall 2022-23

Computer Science Department, University of Crete
HY-559 Infrastructure Technologies for Large-Scale Service-Oriented Systems

info | readings | syllabus | other resources

Course Staff

Name	Email	Office Hours
Instructor: Kostas Magoutis	hy559@csd	By appt./H-311
Teaching Assistant: Stefanos Kalogerakis	hy559@csd	By appt.

General Information

The course meets Mon/Wed at 6pm in A.121. See schedule for exact dates.

Announcements

1.1.2023 10:00: Your project reports are due by Fri Jan 27

28.11.2022 10:00: A short description of your project is due by Wed Dec 7, see Projects HOWTO

14.10.2022 10:00: Please sign up for papers to present asap. Use the link you received over email (hy559-list).

22.07.2022 10:00: You are welcome to get in touch with the instructor to discuss course-related issues.

14.09.2022 10:00: We will be using the AWS Academy cloud platform for course assignments, you may find our course page here.

Course Description

The explosive growth of e-services in recent years has created the need to design, implement, and manage infrastructures that support large-scale service-oriented systems. The course offers an introduction to the scalable infrastructure technologies designed to support large-scale e-services. In the course we will examine existing design techniques and research problems in the design and implementation of these systems as well as their possible solutions.

The course focuses on large-scale service-oriented systems and their architectures (Web services, service-oriented architectures, service mashups, etc.); design principles for scalable high performance; management of infrastructural service-level agreements (SLAs); information lifecycle management; configuration and change management databases and ITIL processes; design optimization to meet application requirements; the role of the human factor in service engagements; service delivery models; and several case studies (Amazon, Google, Yahoo, Facebook).

This course is targeted for graduate students and advanced undergraduates and requires the undertaking of a research project. The topics of the research projects will be chosen with the help and guidance of the course staff. Other requirements include two in-class quizzes, review and presentation of a research paper, and a final exam.

Coursework

Reading and discussing classic and current papers
An in-class quizz
A research project of your choice
Review and presentation of two research papers
A final exam

Prerequisites

Introductory operating systems, database, and service systems courses such as HY-345, HY-360, and (optionally) HY-452

Grading

The final grade depends on an in-class quiz, presentation of two research papers, a research project, and a final exam.

Readings

There are a number of paper readings that are available online. You are expected to read the papers before the beginning of each class.

There is no required textbook for this class. The following textbooks, however, are recommended readings:

M. van Steen and A. S. Tanenbaum: Distributed Systems, 3rd ed. (2017)
Alonso, Casati, Kuno, Machiraju: Web Services: Concepts, Architectures, and Applications, Springer Verlag.

Syllabus

Date	Notes	Readings
Mon 26/9	Course overview	Lecture notes
Wed 28/9	Coordination services 1	Lecture notes, Lamport: Paxos made simple
Mon 3/10	Coordination services 2	Lecture notes
Wed 5/10	Class to be rescheduled	-
Mon 10/10	Coordination services 3	Lecture notes, Hunt: ZooKeeper: Wait-free coordination for Internet-scale systems
Wed 12/10	Coordination services 4	Lecture notes
Mon 17/10	Scalable load balancing 1	Lecture notes, Elson: Handling flash crowds from your garage
Wed 19/10	Scalable load balancing 2	Lecture notes
Mon 24/10	Serving the social graph 1	Lecture notes, Bronson: Facebook's distributed data store for the social graph
Wed 26/10	Serving the social graph 2	Lecture notes
Mon 31/10	Serving the social graph 3	Lecture notes
Wed 2/11	Instructor out of town	No class
Mon 7/11	Microservices platforms 1 & quiz	Lecture notes, Kakivaya: Service Fabric: a distributed platform for building microservices in the cloud
Wed 9/11	Presentations	Presenters: 1237, 1273
Mon 14/11	Presentations	Presenters: 1279, 1293
Wed 16/11	Presentations	Presenters: 1294, 1311
Mon 21/11	Microservices platforms 2	Lecture notes
Wed 23/11	Microservices platforms 3	Lecture notes
Mon 28/11	Scalable causal consistency 1	Lecture notes, Lloyd: Don't Settle for Eventual Consistency
Wed 30/11	Instructor out of town	No class
Mon 5/12	Presentations	Presenters: 1293, 1273
Wed 7/12	Presentations	Presenters: 1294, 1237
Mon 12/12	Presentations	Presenters: 1279, 1311
Wed 14/12	Scalable causal consistency 2	Lecture notes, Lloyd: Don't Settle for Eventual: Scalable Causal Consistency for Wide-Area Storage with COPS
Mon 19/12	Review - putting it all together	Lecture notes

Projects HOWTO

Please note the following project guidelines:

Discuss project ideas with course staff
Prepare a short description (text or pdf) of your goals and deliverables by Wed Dec 7
In preparing your abstract, describe
- What you are trying to achieve
- Your plan to do so and expected deliverables (type of deployments in AWS Academy, evaluation, analysis, etc.)
Project reports (in the ACM paper formatting template) are due Jan 27, 2023.
Prepare a "rapid fire" (10min, up to 6 slides) presentation of your results
Presentations will be delivered in the week 30/1-4/2 (exact date TBD)
You may use this presentation template.

Other Resources

Interesting readings
- Ken Birman's Like it or Not, Web Services are Distributed Objects!
- Marvin Theimer's (Amazon) keynote speech at LADIS'09
- Jim Gray discusses lessons learned from the Amazon technology platform with Werner Vogels
- Jeff Dean's (Google) keynote speech at LADIS'09
- Kirk McKusick discusses the Google File System origins and evolution with Sean Quinlan (Google).
- ACM Queue magazine articles on Web services and Virtualization.
Open-source scalable infrastructure
- Hadoop, Zookeeper, Cassandra, Chord
Links
- LADIS workshops
- HY-559 fall 2021-22
- HY-559 fall 2020-21
- HY-559 fall 2019-20