- Description
- Learning Outcomes
- Contacts
- Delivery of the Learning module
- Schedule
- Requirements
- Assessment
- Resources
- Folder Structure
- Acknowledgement
This module provides an overview of the Design of Machine Learning Systems which are embedded within data-intensive products and applications. It covers the fundamental components of the infrastructure, systems, and methods necessary to implement and maintain Machine Learning (ML) models in production. In short, we will learn methods to build a factory of ML models.
The module has two components:
- A discussion of the main issues and challenges faced in production, together with some approaches to address them.
- A live lab with demonstrations of implementation techniques.
The module covers the following areas:
- Data engineering.
- Feature engineering.
- Hyperparameter tuning.
- Model deployment.
- Model explainability.
- Logging, experiment tracking, and monitoring.
We will discuss the tools and techniques required to do the above in good order and at scale. However, we will not discuss the inner working of models, advantages, and so on. As well, we will not discuss the theoretical aspects of feature engineering or hyperparameter tuning. We will focus on tools and reproducibility.
By the end of this module, participants will be able to:
- Describe the main components of a machine learning system.
- Explain the infrastructure required to train and test models in production.
- Implement an experiment tracking system and logging.
- Contrast and evaluate different approaches of storing and manipulating data.
- Design data flows and processes to automate the construction of ML models.
Questions can be submitted to the #cohort-3-help channel on Slack
-
Technical Facilitator:
-
Learning Support Staff:
This module will include live learning sessions and optional, asynchronous work periods. During live learning sessions, the Technical Facilitator will introduce and explain key concepts and demonstrate core skills. Learning is facilitated during this time. Before and after each live learning session, the instructional team will be available for questions related to the core concepts of the module. Optional work periods are to be used to seek help from peers, the Learning Support team, and to work through the homework and assignments in the learning module, with access to live help. Content is not facilitated, but rather this time should be driven by participants. We encourage participants to come to these work periods with questions and problems to work through. Participants are encouraged to engage actively during the learning module. They key to developing the core skills in each learning module is through practice. The more participants engage in coding along with the instructional team, and applying the skills in each module, the more likely it is that these skills will solidify.
| Live Learning Session | Date | Topic |
|---|---|---|
| 1 | Tue, Oct 22, 2024 | ML System Design |
| 2 | Wed, Oct 23, 2024 | Data Engineering Fundamentals |
| 3 | Thur, Oct 24, 2024 | Working with Training Data |
| NA | Fri, Oct 25, 2024 | Work Period (1-4 PM) |
| NA | Sat, Oct 26, 2024 | Work Period (9 AM-12 PM) |
| 4 | Tue, Oct 29, 2024 | Feature Engineering |
| 5 | Wed, Oct 30, 2024 | Model Development and Evaluation |
| 6 | Thur, Oct 31, 2024 | Model Explanations, and Monitoring |
| NA | Fri, Nov 1, 2024 | Work Period (1-4 PM) |
| NA | Sat, Nov 2, 2024 | Work Period (9 AM-12 PM) |
- Participants are expected to have completed Shell, Git, and Python learning modules.
- Participants are encouraged to ask questions, and collaborate with others to enhance their learning experience.
- Participants must have a computer and an internet connection to participate in online activities.
- Participants must have VSCode installed with the following extensions:
- Participants must install Docker as this module implements a Docker backend that will run a PosgreSQL server. This is intended to mimic a production-like environment. Participants may use SQLite if Docker is not an option.
- Participants must not use generative AI such as ChatGPT to generate code in order to complete assignments. It should be used as a supportive tool to seek out answers to questions you may have.
- We expect participants to have completed the steps in the onboarding repo.
- We encourage participants to default to having their camera on at all times, and turning the camera off only as needed. This will greatly enhance the learning experience for all participants and provides real-time feedback for the instructional team.
- Course participants will receive a Pass/Fail mark.
- The mark will be equally based 50% on average quiz scores and 50% on assignment assessments.
- After each live session you will get access to a quiz on the session's materials.
- Each quiz will contain about 10 questions of different types: true/false, multiple choice, simple selection, etc.
- All quizzes are mandatory and should be submitted by Nov 2.
- An individualized link will be emailed to you after each session. If you do not receive the quiz (check your spam folder) please let us know. Please do not share the link.
- Assignment 1 due on Oct 24. Rubric.
- Assignment 2 due on Oct 31. Rubric.
- Assignment 3 due on Nov 2. Rubric.
- Chip Huyen's DMLS repo on GitHub
- Scikit-Learn User Guide
- Dask Documentation
- Sacred Documentation
- Docker Installation
- Cheatsheet
.
├── .github
├── 01_materials
├── 02_activities
├── 03_instructional_team
├── 04_this_cohort
├── 05_src
├── .gitignore
├── LICENSE
├── README.md
└── steps_to_ask_for_help.png- .github: Contains issue templates and pull request templates for the repository.
- materials: Module slides and interactive notebooks (.ipynb files) used during learning sessions.
- activities: Contains graded assignments, exercises, and homework to practice concepts covered in the learning module.
- instructional_team: Resources for the instructional team.
- this_cohort: Additional materials and resources for cohort three.
- src: Source code, databases, logs, and required dependencies (requirements.txt) needed during the module.
- .gitignore: Files to exclude from this folder, specified by the Technical Facilitator
- LICENSE: The license for this repository.
- README: This file.
- steps_to_ask_for_help.png: Guide on how to ask for help.