Before digging into details of implementations, you should read architecture-and-requirements first to understand overall requirements and architecture.
Here're sub topics of Submarine implementations:
- Submarine Storage: How to store metadata, logs, metrics, etc. of Submarine.
- Submarine Environment: How environments created, managed, stored in Submarine.
- Submarine Experiment: How experiments managed, stored, and how the predefined experiment template works.
- Submarine Notebook: How experiments managed, stored, and how the predefined experiment template works.
- Submarine Server: How Submarine server is designed, architecture, implementation notes, etc.
Working-in-progress designs, Below are designs which are working-in-progress, we will move them to the upper section once design & review is finished:
- Submarine HA Design: How Submarine HA can be achieved, using RAFT, etc.
- Submarine services deployment module: How to deploy submarine services to k8s, YARN or cloud.