Skip to content

Latest commit

 

History

History
53 lines (36 loc) · 2.32 KB

02_training_the_model.md

File metadata and controls

53 lines (36 loc) · 2.32 KB
Raw

Training the model with a notebook

By this point, you should have a Jupyter notebook running at http://127.0.0.1:8000.

Download training files

Open the Jupyter notebook interface and create a new Terminal by clicking on menu, New -> Terminal. In the Terminal, clone this git repo by executing:

git clone https://github.com/kubeflow/examples.git

Now you should have all the code required to complete training in the examples/github_issue_summarization/notebooks folder. Navigate to this folder. Here you should see two files:

  • Training.ipynb
  • seq2seq_utils.py

Perform training

Open the Training.ipynb notebook. This contains a complete walk-through of downloading the training data, preprocessing it, and training it.

Run the Training.ipynb notebook, viewing the output at each step to confirm that the resulting models produce sensible predictions.

Export trained model files

After training completes, download the resulting files to your local machine. The following files are needed for serving results:

  • seq2seq_model_tutorial.h5 - the keras model
  • body_pp.dpkl - the serialized body preprocessor
  • title_pp.dpkl - the serialized title preprocessor

If you haven't already, clone the kubeflow/examples repo locally, then issue the following commands to place these three files into the github_issue_summarization/notebooks folder on your local machine:

cd github_issue_summarization/notebooks
PODNAME=`kubectl get pods --namespace=${NAMESPACE} --selector="app=jupyterhub" --output=template --template="{{with index .items 0}}{{.metadata.name}}{{end}}"`
kubectl --namespace=${NAMESPACE} cp ${PODNAME}:/home/jovyan/examples/github_issue_summarization/notebooks/seq2seq_model_tutorial.h5 .
kubectl --namespace=${NAMESPACE} cp ${PODNAME}:/home/jovyan/examples/github_issue_summarization/notebooks/body_pp.dpkl .
kubectl --namespace=${NAMESPACE} cp ${PODNAME}:/home/jovyan/examples/github_issue_summarization/notebooks/title_pp.dpkl .

(Optional) You can also perform training with two alternate methods:

Next: Serving the model

Back: Setup a kubeflow cluster