Training_a_Model-Sagemaker.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Plagiarism Detection Model\n",
    "\n",
    "Now that you've created training and test data, you are ready to define and train a model. Your goal in this notebook, will be to train a binary classification model that learns to label an answer file as either plagiarized or not, based on the features you provide the model.\n",
    "\n",
    "This task will be broken down into a few discrete steps:\n",
    "\n",
    "* Upload your data to S3.\n",
    "* Define a binary classification model and a training script.\n",
    "* Train your model and deploy it.\n",
    "* Evaluate your deployed classifier and answer some questions about your approach.\n",
    "\n",
    "To complete this notebook, you'll have to complete all given exercises and answer all the questions in this notebook.\n",
    "> All your tasks will be clearly labeled **EXERCISE** and questions as **QUESTION**.\n",
    "\n",
    "It will be up to you to explore different classification models and decide on a model that gives you the best performance for this dataset.\n",
    "\n",
    "---"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## Load Data to S3\n",
    "\n",
    "In the last notebook, you should have created two files: a `training.csv` and `test.csv` file with the features and class labels for the given corpus of plagiarized/non-plagiarized text data. \n",
    "\n",
    ">The below cells load in some AWS SageMaker libraries and creates a default bucket. After creating this bucket, you can upload your locally stored data to S3.\n",
    "\n",
    "Save your train and test `.csv` feature files, locally. To do this you can run the second notebook \"2_Plagiarism_Feature_Engineering\" in SageMaker or you can manually upload your files to this notebook using the upload icon in Jupyter Lab. Then you can upload local files to S3 by using `sagemaker_session.upload_data` and pointing directly to where the training data is saved."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 13,
   "metadata": {},
   "outputs": [],
   "source": [
    "import pandas as pd\n",
    "import boto3\n",
    "import numpy as np\n",
    "import sagemaker\n",
    "import os"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 2,
   "metadata": {},
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "# session and role\n",
    "sagemaker_session = sagemaker.Session()\n",
    "role = sagemaker.get_execution_role()\n",
    "\n",
    "# create an S3 bucket\n",
    "bucket = sagemaker_session.default_bucket()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## EXERCISE: Upload your training data to S3\n",
    "\n",
    "Specify the `data_dir` where you've saved your `train.csv` file. Decide on a descriptive `prefix` that defines where your data will be uploaded in the default S3 bucket. Finally, create a pointer to your training data by calling `sagemaker_session.upload_data` and passing in the required parameters. It may help to look at the [Session documentation](https://sagemaker.readthedocs.io/en/stable/session.html#sagemaker.session.Session.upload_data) or previous SageMaker code examples.\n",
    "\n",
    "You are expected to upload your entire directory. Later, the training script will only access the `train.csv` file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 3,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "s3://sagemaker-ap-northeast-1-819200584124/plagiarism-detection/test.csv\n",
      "s3://sagemaker-ap-northeast-1-819200584124/plagiarism-detection/train.csv\n"
     ]
    }
   ],
   "source": [
    "# should be the name of directory you created to save your features data\n",
    "data_dir = 'plagiarism_data'\n",
    "\n",
    "# set prefix, a descriptive name for a directory  \n",
    "prefix = 'plagiarism-detection'\n",
    "\n",
    "# upload all data to S3\n",
    "test_location = sagemaker_session.upload_data(os.path.join(data_dir, 'test.csv'), key_prefix=prefix)\n",
    "train_location = sagemaker_session.upload_data(os.path.join(data_dir, 'train.csv'), key_prefix=prefix)\n",
    "\n",
    "print(test_location)\n",
    "print(train_location)"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Test cell\n",
    "\n",
    "Test that your data has been successfully uploaded. The below cell prints out the items in your S3 bucket and will throw an error if it is empty. You should see the contents of your `data_dir` and perhaps some checkpoints. If you see any other files listed, then you may have some old model files that you can delete via the S3 console (though, additional files shouldn't affect the performance of model developed in this notebook)."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 4,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "plagiarism-detection/test.csv\n",
      "plagiarism-detection/train.csv\n",
      "sagemaker-pytorch-2021-05-25-13-24-13-024/source/sourcedir.tar.gz\n",
      "sagemaker-pytorch-2021-05-25-13-25-57-466/source/sourcedir.tar.gz\n",
      "sagemaker-pytorch-2021-05-25-14-07-37-350/debug-output/training_job_end.ts\n",
      "sagemaker-pytorch-2021-05-25-14-07-37-350/output/model.tar.gz\n",
      "sagemaker-pytorch-2021-05-25-14-07-37-350/source/sourcedir.tar.gz\n",
      "sagemaker-pytorch-2021-05-26-01-05-19-885/sourcedir.tar.gz\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/profiler-output/system/incremental/2021052615/1622043480.algo-1.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/profiler-output/system/incremental/2021052615/1622043540.algo-1.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-report.html\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-report.ipynb\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/BatchSize.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/CPUBottleneck.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/Dataloader.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/GPUMemoryIncrease.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/IOBottleneck.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/LoadBalancing.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/LowGPUUtilization.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/MaxInitializationTime.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/OverallFrameworkMetrics.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/OverallSystemUsage.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/StepOutlier.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-35-21-141/source/sourcedir.tar.gz\n",
      "sagemaker-scikit-learn-2021-05-26-15-45-46-626/profiler-output/system/incremental/2021052615/1622044080.algo-1.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-45-46-626/profiler-output/system/incremental/2021052615/1622044140.algo-1.json\n",
      "sagemaker-scikit-learn-2021-05-26-15-45-46-626/source/sourcedir.tar.gz\n",
      "sagemaker/sentiment_rnn/train.csv\n",
      "sagemaker/sentiment_rnn/word_dict.pkl\n",
      "Test passed!\n"
     ]
    }
   ],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "# confirm that data is in S3 bucket\n",
    "empty_check = []\n",
    "for obj in boto3.resource('s3').Bucket(bucket).objects.all():\n",
    "    empty_check.append(obj.key)\n",
    "    print(obj.key)\n",
    "\n",
    "assert len(empty_check) !=0, 'S3 bucket is empty.'\n",
    "print('Test passed!')"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---\n",
    "\n",
    "# Modeling\n",
    "\n",
    "Now that you've uploaded your training data, it's time to define and train a model!\n",
    "\n",
    "The type of model you create is up to you. For a binary classification task, you can choose to go one of three routes:\n",
    "* Use a built-in classification algorithm, like LinearLearner.\n",
    "* Define a custom Scikit-learn classifier, a comparison of models can be found [here](https://scikit-learn.org/stable/auto_examples/classification/plot_classifier_comparison.html).\n",
    "* Define a custom PyTorch neural network classifier. \n",
    "\n",
    "It will be up to you to test out a variety of models and choose the best one. Your project will be graded on the accuracy of your final model. \n",
    " \n",
    "---\n",
    "\n",
    "## EXERCISE: Complete a training script \n",
    "\n",
    "To implement a custom classifier, you'll need to complete a `train.py` script. You've been given the folders `source_sklearn` and `source_pytorch` which hold starting code for a custom Scikit-learn model and a PyTorch model, respectively. Each directory has a `train.py` training script. To complete this project **you only need to complete one of these scripts**; the script that is responsible for training your final model.\n",
    "\n",
    "A typical training script:\n",
    "* Loads training data from a specified directory\n",
    "* Parses any training & model hyperparameters (ex. nodes in a neural network, training epochs, etc.)\n",
    "* Instantiates a model of your design, with any specified hyperparams\n",
    "* Trains that model \n",
    "* Finally, saves the model so that it can be hosted/deployed, later\n",
    "\n",
    "### Defining and training a model\n",
    "Much of the training script code is provided for you. Almost all of your work will be done in the `if __name__ == '__main__':` section. To complete a `train.py` file, you will:\n",
    "1. Import any extra libraries you need\n",
    "2. Define any additional model training hyperparameters using `parser.add_argument`\n",
    "2. Define a model in the `if __name__ == '__main__':` section\n",
    "3. Train the model in that same section\n",
    "\n",
    "Below, you can use `!pygmentize` to display an existing `train.py` file. Read through the code; all of your tasks are marked with `TODO` comments. \n",
    "\n",
    "**Note: If you choose to create a custom PyTorch model, you will be responsible for defining the model in the `model.py` file,** and a `predict.py` file is provided. If you choose to use Scikit-learn, you only need a `train.py` file; you may import a classifier from the `sklearn` library."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 5,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "\u001b[34mfrom\u001b[39;49;00m \u001b[04m\u001b[36m__future__\u001b[39;49;00m \u001b[34mimport\u001b[39;49;00m print_function\n",
      "\n",
      "\u001b[34mimport\u001b[39;49;00m \u001b[04m\u001b[36margparse\u001b[39;49;00m\n",
      "\u001b[34mimport\u001b[39;49;00m \u001b[04m\u001b[36mos\u001b[39;49;00m\n",
      "\u001b[34mimport\u001b[39;49;00m \u001b[04m\u001b[36mpandas\u001b[39;49;00m \u001b[34mas\u001b[39;49;00m \u001b[04m\u001b[36mpd\u001b[39;49;00m\n",
      "\n",
      "\u001b[37m# sklearn.externals.joblib is deprecated in 0.21 and will be removed in 0.23. \u001b[39;49;00m\n",
      "\u001b[37m# from sklearn.externals import joblib\u001b[39;49;00m\n",
      "\u001b[37m# Import joblib package directly\u001b[39;49;00m\n",
      "\u001b[34mimport\u001b[39;49;00m \u001b[04m\u001b[36mjoblib\u001b[39;49;00m\n",
      "\n",
      "\u001b[37m## TODO: Import any additional libraries you need to define a model\u001b[39;49;00m\n",
      "\n",
      "\n",
      "\u001b[37m# Provided model load function\u001b[39;49;00m\n",
      "\u001b[34mdef\u001b[39;49;00m \u001b[32mmodel_fn\u001b[39;49;00m(model_dir):\n",
      "    \u001b[33m\"\"\"Load model from the model_dir. This is the same model that is saved\u001b[39;49;00m\n",
      "\u001b[33m    in the main if statement.\u001b[39;49;00m\n",
      "\u001b[33m    \"\"\"\u001b[39;49;00m\n",
      "    \u001b[36mprint\u001b[39;49;00m(\u001b[33m\"\u001b[39;49;00m\u001b[33mLoading model.\u001b[39;49;00m\u001b[33m\"\u001b[39;49;00m)\n",
      "    \n",
      "    \u001b[37m# load using joblib\u001b[39;49;00m\n",
      "    model = joblib.load(os.path.join(model_dir, \u001b[33m\"\u001b[39;49;00m\u001b[33mmodel.joblib\u001b[39;49;00m\u001b[33m\"\u001b[39;49;00m))\n",
      "    \u001b[36mprint\u001b[39;49;00m(\u001b[33m\"\u001b[39;49;00m\u001b[33mDone loading model.\u001b[39;49;00m\u001b[33m\"\u001b[39;49;00m)\n",
      "    \n",
      "    \u001b[34mreturn\u001b[39;49;00m model\n",
      "\n",
      "\n",
      "\u001b[37m## TODO: Complete the main code\u001b[39;49;00m\n",
      "\u001b[34mif\u001b[39;49;00m \u001b[31m__name__\u001b[39;49;00m == \u001b[33m'\u001b[39;49;00m\u001b[33m__main__\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m:\n",
      "    \n",
      "    \u001b[37m# All of the model parameters and training parameters are sent as arguments\u001b[39;49;00m\n",
      "    \u001b[37m# when this script is executed, during a training job\u001b[39;49;00m\n",
      "    \n",
      "    \u001b[37m# Here we set up an argument parser to easily access the parameters\u001b[39;49;00m\n",
      "    parser = argparse.ArgumentParser()\n",
      "\n",
      "    \u001b[37m# SageMaker parameters, like the directories for training data and saving models; set automatically\u001b[39;49;00m\n",
      "    \u001b[37m# Do not need to change\u001b[39;49;00m\n",
      "    parser.add_argument(\u001b[33m'\u001b[39;49;00m\u001b[33m--output-data-dir\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m, \u001b[36mtype\u001b[39;49;00m=\u001b[36mstr\u001b[39;49;00m, default=os.environ[\u001b[33m'\u001b[39;49;00m\u001b[33mSM_OUTPUT_DATA_DIR\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m])\n",
      "    parser.add_argument(\u001b[33m'\u001b[39;49;00m\u001b[33m--model-dir\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m, \u001b[36mtype\u001b[39;49;00m=\u001b[36mstr\u001b[39;49;00m, default=os.environ[\u001b[33m'\u001b[39;49;00m\u001b[33mSM_MODEL_DIR\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m])\n",
      "    parser.add_argument(\u001b[33m'\u001b[39;49;00m\u001b[33m--data-dir\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m, \u001b[36mtype\u001b[39;49;00m=\u001b[36mstr\u001b[39;49;00m, default=os.environ[\u001b[33m'\u001b[39;49;00m\u001b[33mSM_CHANNEL_TRAIN\u001b[39;49;00m\u001b[33m'\u001b[39;49;00m])\n",
      "    \n",
      "    \u001b[37m## TODO: Add any additional arguments that you will need to pass into your model\u001b[39;49;00m\n",
      "    \n",
      "    \u001b[37m# args holds all passed-in arguments\u001b[39;49;00m\n",
      "    args = parser.parse_args()\n",
      "\n",
      "    \u001b[37m# Read in csv training file\u001b[39;49;00m\n",
      "    training_dir = args.data_dir\n",
      "    train_data = pd.read_csv(os.path.join(training_dir, \u001b[33m\"\u001b[39;49;00m\u001b[33mtrain.csv\u001b[39;49;00m\u001b[33m\"\u001b[39;49;00m), header=\u001b[34mNone\u001b[39;49;00m, names=\u001b[34mNone\u001b[39;49;00m)\n",
      "\n",
      "    \u001b[37m# Labels are in the first column\u001b[39;49;00m\n",
      "    train_y = train_data.iloc[:,\u001b[34m0\u001b[39;49;00m]\n",
      "    train_x = train_data.iloc[:,\u001b[34m1\u001b[39;49;00m:]\n",
      "    \n",
      "    \n",
      "    \u001b[37m## --- Your code here --- ##\u001b[39;49;00m\n",
      "    \n",
      "\n",
      "    \u001b[37m## TODO: Define a model \u001b[39;49;00m\n",
      "    model = \u001b[34mNone\u001b[39;49;00m\n",
      "    \n",
      "    \n",
      "    \u001b[37m## TODO: Train the model\u001b[39;49;00m\n",
      "    \n",
      "    \n",
      "    \n",
      "    \u001b[37m## --- End of your code  --- ##\u001b[39;49;00m\n",
      "    \n",
      "\n",
      "    \u001b[37m# Save the trained model\u001b[39;49;00m\n",
      "    joblib.dump(model, os.path.join(args.model_dir, \u001b[33m\"\u001b[39;49;00m\u001b[33mmodel.joblib\u001b[39;49;00m\u001b[33m\"\u001b[39;49;00m))\n"
     ]
    }
   ],
   "source": [
    "# directory can be changed to: source_sklearn or source_pytorch\n",
    "!pygmentize source_sklearn/train.py"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Provided code\n",
    "\n",
    "If you read the code above, you can see that the starter code includes a few things:\n",
    "* Model loading (`model_fn`) and saving code\n",
    "* Getting SageMaker's default hyperparameters\n",
    "* Loading the training data by name, `train.csv` and extracting the features and labels, `train_x`, and `train_y`\n",
    "\n",
    "If you'd like to read more about model saving with [joblib for sklearn](https://scikit-learn.org/stable/modules/model_persistence.html) or with [torch.save](https://pytorch.org/tutorials/beginner/saving_loading_models.html), click on the provided links."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---\n",
    "# Create an Estimator\n",
    "\n",
    "When a custom model is constructed in SageMaker, an entry point must be specified. This is the Python file which will be executed when the model is trained; the `train.py` function you specified above. To run a custom training script in SageMaker, construct an estimator, and fill in the appropriate constructor arguments:\n",
    "\n",
    "* **entry_point**: The path to the Python script SageMaker runs for training and prediction.\n",
    "* **source_dir**: The path to the training script directory `source_sklearn` OR `source_pytorch`.\n",
    "* **role**: Role ARN, which was specified, above.\n",
    "* **train_instance_count**: The number of training instances (should be left at 1).\n",
    "* **train_instance_type**: The type of SageMaker instance for training. Note: Because Scikit-learn does not natively support GPU training, Sagemaker Scikit-learn does not currently support training on GPU instance types.\n",
    "* **sagemaker_session**: The session used to train on Sagemaker.\n",
    "* **hyperparameters** (optional): A dictionary `{'name':value, ..}` passed to the train function as hyperparameters.\n",
    "\n",
    "Note: For a PyTorch model, there is another optional argument **framework_version**, which you can set to the latest version of PyTorch, `1.0`.\n",
    "\n",
    "## EXERCISE: Define a Scikit-learn or PyTorch estimator\n",
    "\n",
    "To import your desired estimator, use one of the following lines:\n",
    "```\n",
    "from sagemaker.sklearn.estimator import SKLearn\n",
    "```\n",
    "```\n",
    "from sagemaker.pytorch import PyTorch\n",
    "```"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 6,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "The method get_image_uri has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.\n",
      "train_instance_count has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "train_instance_type has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n"
     ]
    }
   ],
   "source": [
    "# your import and estimator code, here\n",
    "# an error in training solved with https://github.com/aws/sagemaker-python-sdk/issues/819\n",
    "s3_input_train = sagemaker.TrainingInput(s3_data=train_location, content_type='text/csv')\n",
    "s3_input_test = sagemaker.TrainingInput(s3_data=test_location, content_type='text/csv')\n",
    "\n",
    "output_path = 's3://{}/{}'.format(bucket, prefix)\n",
    "\n",
    "from sagemaker.amazon.amazon_estimator import get_image_uri\n",
    "container = get_image_uri(boto3.Session().region_name, 'linear-learner')\n",
    "\n",
    "linear = sagemaker.estimator.Estimator(container,\n",
    "                                       role, \n",
    "                                       train_instance_count=1, \n",
    "                                       train_instance_type='ml.c4.xlarge',\n",
    "                                       output_path=output_path,\n",
    "                                       sagemaker_session=sagemaker_session\n",
    "                                      )\n",
    "\n",
    "linear.set_hyperparameters(predictor_type='binary_classifier',\n",
    "                           mini_batch_size=10\n",
    "                           )"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## EXERCISE: Train the estimator\n",
    "\n",
    "Train your estimator on the training data stored in S3. This should create a training job that you can monitor in your SageMaker console."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 7,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "2021-05-26 15:53:47 Starting - Starting the training job...\n",
      "2021-05-26 15:54:09 Starting - Launching requested ML instancesProfilerReport-1622044426: InProgress\n",
      ".........\n",
      "2021-05-26 15:55:30 Starting - Preparing the instances for training.........\n",
      "2021-05-26 15:57:17 Downloading - Downloading input data......\n",
      "2021-05-26 15:58:12 Training - Training image download completed. Training in progress..\u001b[34mDocker entrypoint called with argument(s): train\u001b[0m\n",
      "\u001b[34mRunning default environment configuration script\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-input.json: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false'}\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'predictor_type': 'binary_classifier', 'mini_batch_size': '10'}\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Final configuration: {'mini_batch_size': '10', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false', 'predictor_type': 'binary_classifier'}\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 WARNING 140220882560832] Loggers have already been setup.\u001b[0m\n",
      "\u001b[34mProcess 1 is a worker.\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Using default worker.\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Checkpoint loading and saving are disabled.\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Create Store: local\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Scaler algorithm parameters\n",
      " <algorithm.scaler.ScalerAlgorithmStable object at 0x7f8756e97890>\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Scaling model computed with parameters:\n",
      " {'stdev_label': None, 'stdev_weight': \u001b[0m\n",
      "\u001b[34m[0.19045913 0.266688   0.24899505]\u001b[0m\n",
      "\u001b[34m<NDArray 3 @cpu(0)>, 'mean_label': None, 'mean_weight': \u001b[0m\n",
      "\u001b[34m[0.64699847 0.19143713 0.44681007]\u001b[0m\n",
      "\u001b[34m<NDArray 3 @cpu(0)>}\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] nvidia-smi: took 0.030 seconds to run.\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] nvidia-smi identified 0 GPUs.\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:16 INFO 140220882560832] Number of GPUs being used: 0\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044696.827359, \"EndTime\": 1622044696.8273928, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"Meta\": \"init_train_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 80.0, \"count\": 1, \"min\": 80, \"max\": 80}, \"Total Batches Seen\": {\"sum\": 8.0, \"count\": 1, \"min\": 8, \"max\": 8}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 2.0, \"count\": 1, \"min\": 2, \"max\": 2}, \"Number of Records Since Last Reset\": {\"sum\": 0.0, \"count\": 1, \"min\": 0, \"max\": 0}, \"Number of Batches Since Last Reset\": {\"sum\": 0.0, \"count\": 1, \"min\": 0, \"max\": 0}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0991657, \"EndTime\": 1622044697.0992196, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6646558897835868, \"count\": 1, \"min\": 0.6646558897835868, \"max\": 0.6646558897835868}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0992928, \"EndTime\": 1622044697.0993073, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6534765584128244, \"count\": 1, \"min\": 0.6534765584128244, \"max\": 0.6534765584128244}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0993671, \"EndTime\": 1622044697.0993853, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7144927024841309, \"count\": 1, \"min\": 0.7144927024841309, \"max\": 0.7144927024841309}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0994332, \"EndTime\": 1622044697.09945, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6510482924325126, \"count\": 1, \"min\": 0.6510482924325126, \"max\": 0.6510482924325126}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0995052, \"EndTime\": 1622044697.0995226, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5915767124720982, \"count\": 1, \"min\": 0.5915767124720982, \"max\": 0.5915767124720982}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0995843, \"EndTime\": 1622044697.099602, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5778619664055961, \"count\": 1, \"min\": 0.5778619664055961, \"max\": 0.5778619664055961}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0996523, \"EndTime\": 1622044697.099668, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6098551477704729, \"count\": 1, \"min\": 0.6098551477704729, \"max\": 0.6098551477704729}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0997167, \"EndTime\": 1622044697.0997336, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5686869757516043, \"count\": 1, \"min\": 0.5686869757516043, \"max\": 0.5686869757516043}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0997853, \"EndTime\": 1622044697.0998015, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6986410549708775, \"count\": 1, \"min\": 0.6986410549708775, \"max\": 0.6986410549708775}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.099852, \"EndTime\": 1622044697.0998683, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6898390088762556, \"count\": 1, \"min\": 0.6898390088762556, \"max\": 0.6898390088762556}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.0999196, \"EndTime\": 1622044697.0999358, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6451145580836705, \"count\": 1, \"min\": 0.6451145580836705, \"max\": 0.6451145580836705}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.099986, \"EndTime\": 1622044697.1000016, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6682579789842878, \"count\": 1, \"min\": 0.6682579789842878, \"max\": 0.6682579789842878}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.100061, \"EndTime\": 1622044697.1000764, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5877619062151228, \"count\": 1, \"min\": 0.5877619062151228, \"max\": 0.5877619062151228}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.100125, \"EndTime\": 1622044697.1001408, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5872526509421212, \"count\": 1, \"min\": 0.5872526509421212, \"max\": 0.5872526509421212}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1001992, \"EndTime\": 1622044697.1002173, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6012137753622873, \"count\": 1, \"min\": 0.6012137753622873, \"max\": 0.6012137753622873}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1002786, \"EndTime\": 1622044697.1002948, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5873679978506906, \"count\": 1, \"min\": 0.5873679978506906, \"max\": 0.5873679978506906}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1003478, \"EndTime\": 1622044697.1003633, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6656287397657122, \"count\": 1, \"min\": 0.6656287397657122, \"max\": 0.6656287397657122}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1004145, \"EndTime\": 1622044697.1004298, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6621103354862758, \"count\": 1, \"min\": 0.6621103354862758, \"max\": 0.6621103354862758}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1004798, \"EndTime\": 1622044697.100495, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.688723121370588, \"count\": 1, \"min\": 0.688723121370588, \"max\": 0.688723121370588}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1005435, \"EndTime\": 1622044697.1005585, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7170184544154576, \"count\": 1, \"min\": 0.7170184544154576, \"max\": 0.7170184544154576}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.10061, \"EndTime\": 1622044697.1006262, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6072719846452985, \"count\": 1, \"min\": 0.6072719846452985, \"max\": 0.6072719846452985}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.100679, \"EndTime\": 1622044697.1006944, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.599995790209089, \"count\": 1, \"min\": 0.599995790209089, \"max\": 0.599995790209089}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.100725, \"EndTime\": 1622044697.1007366, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6040373359407697, \"count\": 1, \"min\": 0.6040373359407697, \"max\": 0.6040373359407697}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1007848, \"EndTime\": 1622044697.1007974, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6061948946544102, \"count\": 1, \"min\": 0.6061948946544102, \"max\": 0.6061948946544102}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1008456, \"EndTime\": 1622044697.1008604, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6997745309557234, \"count\": 1, \"min\": 0.6997745309557234, \"max\": 0.6997745309557234}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1009052, \"EndTime\": 1622044697.1009183, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7013699122837611, \"count\": 1, \"min\": 0.7013699122837611, \"max\": 0.7013699122837611}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1009681, \"EndTime\": 1622044697.1009786, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.670195232118879, \"count\": 1, \"min\": 0.670195232118879, \"max\": 0.670195232118879}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1010168, \"EndTime\": 1622044697.1010299, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7062402316502162, \"count\": 1, \"min\": 0.7062402316502162, \"max\": 0.7062402316502162}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1010585, \"EndTime\": 1622044697.1010664, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7643004894256592, \"count\": 1, \"min\": 0.7643004894256592, \"max\": 0.7643004894256592}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1011055, \"EndTime\": 1622044697.1011205, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7661051954541888, \"count\": 1, \"min\": 0.7661051954541888, \"max\": 0.7661051954541888}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1011708, \"EndTime\": 1622044697.101187, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7658561025347028, \"count\": 1, \"min\": 0.7658561025347028, \"max\": 0.7658561025347028}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.1012387, \"EndTime\": 1622044697.1012545, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7615086419241769, \"count\": 1, \"min\": 0.7615086419241769, \"max\": 0.7615086419241769}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy_objective <loss>=0.6646558897835868\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=0, criteria=binary_classification_cross_entropy_objective, value=0.5686869757516043\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Epoch 0: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Saving model for epoch: 0\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpdcurgstn/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #progress_metric: host=algo-1, completed 6.666666666666667 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044696.8276544, \"EndTime\": 1622044697.1159332, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 0, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 150.0, \"count\": 1, \"min\": 150, \"max\": 150}, \"Total Batches Seen\": {\"sum\": 15.0, \"count\": 1, \"min\": 15, \"max\": 15}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 3.0, \"count\": 1, \"min\": 3, \"max\": 3}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=242.72291596913067 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3974614, \"EndTime\": 1622044697.3975186, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6222660950251988, \"count\": 1, \"min\": 0.6222660950251988, \"max\": 0.6222660950251988}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3975952, \"EndTime\": 1622044697.3976104, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6118594578334263, \"count\": 1, \"min\": 0.6118594578334263, \"max\": 0.6118594578334263}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3977041, \"EndTime\": 1622044697.397723, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6688179016113281, \"count\": 1, \"min\": 0.6688179016113281, \"max\": 0.6688179016113281}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3977888, \"EndTime\": 1622044697.3978074, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6096224103655133, \"count\": 1, \"min\": 0.6096224103655133, \"max\": 0.6096224103655133}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.397866, \"EndTime\": 1622044697.3978841, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.3557102050100054, \"count\": 1, \"min\": 0.3557102050100054, \"max\": 0.3557102050100054}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3979394, \"EndTime\": 1622044697.3979561, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.3524810263088771, \"count\": 1, \"min\": 0.3524810263088771, \"max\": 0.3524810263088771}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3980143, \"EndTime\": 1622044697.3980305, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.36044461727142335, \"count\": 1, \"min\": 0.36044461727142335, \"max\": 0.36044461727142335}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3980796, \"EndTime\": 1622044697.398096, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.3501168216977801, \"count\": 1, \"min\": 0.3501168216977801, \"max\": 0.3501168216977801}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3981476, \"EndTime\": 1622044697.3981643, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6539479596274239, \"count\": 1, \"min\": 0.6539479596274239, \"max\": 0.6539479596274239}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3982189, \"EndTime\": 1622044697.398256, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6456603799547468, \"count\": 1, \"min\": 0.6456603799547468, \"max\": 0.6456603799547468}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3983166, \"EndTime\": 1622044697.3983328, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6040075302124024, \"count\": 1, \"min\": 0.6040075302124024, \"max\": 0.6040075302124024}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3983986, \"EndTime\": 1622044697.3984158, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6256669180733817, \"count\": 1, \"min\": 0.6256669180733817, \"max\": 0.6256669180733817}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3984709, \"EndTime\": 1622044697.398487, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.3552089895520891, \"count\": 1, \"min\": 0.3552089895520891, \"max\": 0.3552089895520891}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3985412, \"EndTime\": 1622044697.3985577, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.35545364788600375, \"count\": 1, \"min\": 0.35545364788600375, \"max\": 0.35545364788600375}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3986108, \"EndTime\": 1622044697.3986266, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.3582254597118923, \"count\": 1, \"min\": 0.3582254597118923, \"max\": 0.3582254597118923}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3986752, \"EndTime\": 1622044697.3986893, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.3553219165120806, \"count\": 1, \"min\": 0.3553219165120806, \"max\": 0.3553219165120806}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3987355, \"EndTime\": 1622044697.3987508, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6237887859344482, \"count\": 1, \"min\": 0.6237887859344482, \"max\": 0.6237887859344482}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.398828, \"EndTime\": 1622044697.3988447, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6205176421574183, \"count\": 1, \"min\": 0.6205176421574183, \"max\": 0.6205176421574183}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3988955, \"EndTime\": 1622044697.3989122, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6448949677603585, \"count\": 1, \"min\": 0.6448949677603585, \"max\": 0.6448949677603585}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.398966, \"EndTime\": 1622044697.3989816, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6715349129268101, \"count\": 1, \"min\": 0.6715349129268101, \"max\": 0.6715349129268101}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3990324, \"EndTime\": 1622044697.3990486, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5361438206263951, \"count\": 1, \"min\": 0.5361438206263951, \"max\": 0.5361438206263951}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3991017, \"EndTime\": 1622044697.3991182, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5470333746501378, \"count\": 1, \"min\": 0.5470333746501378, \"max\": 0.5470333746501378}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3991725, \"EndTime\": 1622044697.399189, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5406378303255354, \"count\": 1, \"min\": 0.5406378303255354, \"max\": 0.5406378303255354}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3992395, \"EndTime\": 1622044697.3992558, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5389900752476283, \"count\": 1, \"min\": 0.5389900752476283, \"max\": 0.5389900752476283}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3993046, \"EndTime\": 1622044697.3993196, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6838137422289167, \"count\": 1, \"min\": 0.6838137422289167, \"max\": 0.6838137422289167}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3993719, \"EndTime\": 1622044697.3993878, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6776171752384731, \"count\": 1, \"min\": 0.6776171752384731, \"max\": 0.6776171752384731}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3994403, \"EndTime\": 1622044697.3994567, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6729477541787284, \"count\": 1, \"min\": 0.6729477541787284, \"max\": 0.6729477541787284}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3995082, \"EndTime\": 1622044697.3995235, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6797959872654507, \"count\": 1, \"min\": 0.6797959872654507, \"max\": 0.6797959872654507}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.39958, \"EndTime\": 1622044697.3995967, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7080731664385115, \"count\": 1, \"min\": 0.7080731664385115, \"max\": 0.7080731664385115}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3996494, \"EndTime\": 1622044697.3996654, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7056770597185408, \"count\": 1, \"min\": 0.7056770597185408, \"max\": 0.7056770597185408}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.3997166, \"EndTime\": 1622044697.3997319, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7100175721304757, \"count\": 1, \"min\": 0.7100175721304757, \"max\": 0.7100175721304757}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.399778, \"EndTime\": 1622044697.39979, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.7213720049176897, \"count\": 1, \"min\": 0.7213720049176897, \"max\": 0.7213720049176897}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy_objective <loss>=0.6222660950251988\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=1, criteria=binary_classification_cross_entropy_objective, value=0.3501168216977801\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Epoch 1: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Saving model for epoch: 1\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpycy88dm6/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #progress_metric: host=algo-1, completed 13.333333333333334 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.116201, \"EndTime\": 1622044697.4124622, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 1, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 220.0, \"count\": 1, \"min\": 220, \"max\": 220}, \"Total Batches Seen\": {\"sum\": 22.0, \"count\": 1, \"min\": 22, \"max\": 22}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 4.0, \"count\": 1, \"min\": 4, \"max\": 4}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=236.195024158398 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7502217, \"EndTime\": 1622044697.7502804, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5910543101174491, \"count\": 1, \"min\": 0.5910543101174491, \"max\": 0.5910543101174491}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7503583, \"EndTime\": 1622044697.7503731, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.581247683933803, \"count\": 1, \"min\": 0.581247683933803, \"max\": 0.581247683933803}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7504168, \"EndTime\": 1622044697.7504265, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6341747147696358, \"count\": 1, \"min\": 0.6341747147696358, \"max\": 0.6341747147696358}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.750456, \"EndTime\": 1622044697.7504644, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5791942323957171, \"count\": 1, \"min\": 0.5791942323957171, \"max\": 0.5791942323957171}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7504897, \"EndTime\": 1622044697.7505016, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2892270692757198, \"count\": 1, \"min\": 0.2892270692757198, \"max\": 0.2892270692757198}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7505448, \"EndTime\": 1622044697.750555, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.28689112067222594, \"count\": 1, \"min\": 0.28689112067222594, \"max\": 0.28689112067222594}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7505822, \"EndTime\": 1622044697.7505894, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.29218625937189374, \"count\": 1, \"min\": 0.29218625937189374, \"max\": 0.29218625937189374}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.750613, \"EndTime\": 1622044697.7506201, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.28570571541786194, \"count\": 1, \"min\": 0.28570571541786194, \"max\": 0.28570571541786194}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7506437, \"EndTime\": 1622044697.7506506, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6203578131539481, \"count\": 1, \"min\": 0.6203578131539481, \"max\": 0.6203578131539481}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.750673, \"EndTime\": 1622044697.75068, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6124474048614502, \"count\": 1, \"min\": 0.6124474048614502, \"max\": 0.6124474048614502}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7507026, \"EndTime\": 1622044697.7507095, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5740976401737758, \"count\": 1, \"min\": 0.5740976401737758, \"max\": 0.5740976401737758}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.750744, \"EndTime\": 1622044697.7507582, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5940467017037528, \"count\": 1, \"min\": 0.5940467017037528, \"max\": 0.5940467017037528}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.750827, \"EndTime\": 1622044697.7508376, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2889982657773154, \"count\": 1, \"min\": 0.2889982657773154, \"max\": 0.2889982657773154}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7508628, \"EndTime\": 1622044697.7508702, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.28876961639949256, \"count\": 1, \"min\": 0.28876961639949256, \"max\": 0.28876961639949256}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7508981, \"EndTime\": 1622044697.7509115, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.29016941274915425, \"count\": 1, \"min\": 0.29016941274915425, \"max\": 0.29016941274915425}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7509604, \"EndTime\": 1622044697.750986, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2885716233934675, \"count\": 1, \"min\": 0.2885716233934675, \"max\": 0.2885716233934675}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7510362, \"EndTime\": 1622044697.7510517, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5939528260912214, \"count\": 1, \"min\": 0.5939528260912214, \"max\": 0.5939528260912214}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7511013, \"EndTime\": 1622044697.7511163, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.590825435093471, \"count\": 1, \"min\": 0.590825435093471, \"max\": 0.590825435093471}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7511654, \"EndTime\": 1622044697.7511806, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6129767690386091, \"count\": 1, \"min\": 0.6129767690386091, \"max\": 0.6129767690386091}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7512293, \"EndTime\": 1622044697.7512445, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6375581536974225, \"count\": 1, \"min\": 0.6375581536974225, \"max\": 0.6375581536974225}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.751294, \"EndTime\": 1622044697.7513092, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5646152155739921, \"count\": 1, \"min\": 0.5646152155739921, \"max\": 0.5646152155739921}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7513807, \"EndTime\": 1622044697.751397, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5583472864968436, \"count\": 1, \"min\": 0.5583472864968436, \"max\": 0.5583472864968436}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7514462, \"EndTime\": 1622044697.751461, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5623939922877721, \"count\": 1, \"min\": 0.5623939922877721, \"max\": 0.5623939922877721}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7515104, \"EndTime\": 1622044697.7515264, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5629606860024589, \"count\": 1, \"min\": 0.5629606860024589, \"max\": 0.5629606860024589}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.751579, \"EndTime\": 1622044697.7515955, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6678182874407087, \"count\": 1, \"min\": 0.6678182874407087, \"max\": 0.6678182874407087}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7516496, \"EndTime\": 1622044697.751666, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6680075849805559, \"count\": 1, \"min\": 0.6680075849805559, \"max\": 0.6680075849805559}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7517238, \"EndTime\": 1622044697.751738, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6764432975224086, \"count\": 1, \"min\": 0.6764432975224086, \"max\": 0.6764432975224086}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7517867, \"EndTime\": 1622044697.7518027, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6683901105608259, \"count\": 1, \"min\": 0.6683901105608259, \"max\": 0.6683901105608259}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7518516, \"EndTime\": 1622044697.7518618, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6858325345175607, \"count\": 1, \"min\": 0.6858325345175607, \"max\": 0.6858325345175607}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7519062, \"EndTime\": 1622044697.7519212, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.687147991997855, \"count\": 1, \"min\": 0.687147991997855, \"max\": 0.687147991997855}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7519674, \"EndTime\": 1622044697.7519774, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6840058735438755, \"count\": 1, \"min\": 0.6840058735438755, \"max\": 0.6840058735438755}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7520497, \"EndTime\": 1622044697.7520611, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.683026899610247, \"count\": 1, \"min\": 0.683026899610247, \"max\": 0.683026899610247}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy_objective <loss>=0.5910543101174491\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=2, criteria=binary_classification_cross_entropy_objective, value=0.28570571541786194\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Epoch 2: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Saving model for epoch: 2\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpv3d0y1sz/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #progress_metric: host=algo-1, completed 20.0 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.4127486, \"EndTime\": 1622044697.7643108, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 2, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 290.0, \"count\": 1, \"min\": 290, \"max\": 290}, \"Total Batches Seen\": {\"sum\": 29.0, \"count\": 1, \"min\": 29, \"max\": 29}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 5.0, \"count\": 1, \"min\": 5, \"max\": 5}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:17 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=199.04402338350314 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1304743, \"EndTime\": 1622044698.1305723, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5665860380445208, \"count\": 1, \"min\": 0.5665860380445208, \"max\": 0.5665860380445208}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1306958, \"EndTime\": 1622044698.1307206, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.557245295388358, \"count\": 1, \"min\": 0.557245295388358, \"max\": 0.557245295388358}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.130804, \"EndTime\": 1622044698.1308439, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.606482982635498, \"count\": 1, \"min\": 0.606482982635498, \"max\": 0.606482982635498}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1309044, \"EndTime\": 1622044698.1309235, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5553605352129255, \"count\": 1, \"min\": 0.5553605352129255, \"max\": 0.5553605352129255}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.130979, \"EndTime\": 1622044698.130997, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25936713559286934, \"count\": 1, \"min\": 0.25936713559286934, \"max\": 0.25936713559286934}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1310518, \"EndTime\": 1622044698.131069, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2578719615936279, \"count\": 1, \"min\": 0.2578719615936279, \"max\": 0.2578719615936279}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.131131, \"EndTime\": 1622044698.1311448, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2615526420729501, \"count\": 1, \"min\": 0.2615526420729501, \"max\": 0.2615526420729501}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1311946, \"EndTime\": 1622044698.13121, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2571719970021929, \"count\": 1, \"min\": 0.2571719970021929, \"max\": 0.2571719970021929}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1312637, \"EndTime\": 1622044698.1312795, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5936741897038051, \"count\": 1, \"min\": 0.5936741897038051, \"max\": 0.5936741897038051}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.131327, \"EndTime\": 1622044698.131343, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5860243252345494, \"count\": 1, \"min\": 0.5860243252345494, \"max\": 0.5860243252345494}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1313925, \"EndTime\": 1622044698.1314085, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5508535521371024, \"count\": 1, \"min\": 0.5508535521371024, \"max\": 0.5508535521371024}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1314588, \"EndTime\": 1622044698.1314752, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5691043240683419, \"count\": 1, \"min\": 0.5691043240683419, \"max\": 0.5691043240683419}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1315303, \"EndTime\": 1622044698.1315477, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.26203680208751134, \"count\": 1, \"min\": 0.26203680208751134, \"max\": 0.26203680208751134}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1316, \"EndTime\": 1622044698.1316164, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.26212609665734427, \"count\": 1, \"min\": 0.26212609665734427, \"max\": 0.26212609665734427}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1316664, \"EndTime\": 1622044698.1316826, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.26235046897615705, \"count\": 1, \"min\": 0.26235046897615705, \"max\": 0.26235046897615705}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1317308, \"EndTime\": 1622044698.1317465, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.26189962114606585, \"count\": 1, \"min\": 0.26189962114606585, \"max\": 0.26189962114606585}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1317947, \"EndTime\": 1622044698.1318078, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5720674787248884, \"count\": 1, \"min\": 0.5720674787248884, \"max\": 0.5720674787248884}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1318552, \"EndTime\": 1622044698.13187, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.569067553111485, \"count\": 1, \"min\": 0.569067553111485, \"max\": 0.569067553111485}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1319203, \"EndTime\": 1622044698.1319368, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5890139716012137, \"count\": 1, \"min\": 0.5890139716012137, \"max\": 0.5890139716012137}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1319869, \"EndTime\": 1622044698.132003, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6114237580980574, \"count\": 1, \"min\": 0.6114237580980574, \"max\": 0.6114237580980574}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1320562, \"EndTime\": 1622044698.1320734, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5144705329622541, \"count\": 1, \"min\": 0.5144705329622541, \"max\": 0.5144705329622541}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1321244, \"EndTime\": 1622044698.1321416, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5159561565944126, \"count\": 1, \"min\": 0.5159561565944126, \"max\": 0.5159561565944126}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1321907, \"EndTime\": 1622044698.1322055, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.514696707044329, \"count\": 1, \"min\": 0.514696707044329, \"max\": 0.514696707044329}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1322548, \"EndTime\": 1622044698.132271, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.515147682598659, \"count\": 1, \"min\": 0.515147682598659, \"max\": 0.515147682598659}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1323218, \"EndTime\": 1622044698.1323373, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6644532408033098, \"count\": 1, \"min\": 0.6644532408033098, \"max\": 0.6644532408033098}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1323886, \"EndTime\": 1622044698.1324055, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6662794862474714, \"count\": 1, \"min\": 0.6662794862474714, \"max\": 0.6662794862474714}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1324592, \"EndTime\": 1622044698.1324759, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.673567043031965, \"count\": 1, \"min\": 0.673567043031965, \"max\": 0.673567043031965}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1325274, \"EndTime\": 1622044698.1325438, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6653061389923096, \"count\": 1, \"min\": 0.6653061389923096, \"max\": 0.6653061389923096}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1325939, \"EndTime\": 1622044698.1326096, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6842084067208426, \"count\": 1, \"min\": 0.6842084067208426, \"max\": 0.6842084067208426}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.132659, \"EndTime\": 1622044698.1326745, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.682972764968872, \"count\": 1, \"min\": 0.682972764968872, \"max\": 0.682972764968872}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1327236, \"EndTime\": 1622044698.1327393, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6846599102020263, \"count\": 1, \"min\": 0.6846599102020263, \"max\": 0.6846599102020263}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1327891, \"EndTime\": 1622044698.132806, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6816318307604109, \"count\": 1, \"min\": 0.6816318307604109, \"max\": 0.6816318307604109}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy_objective <loss>=0.5665860380445208\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=3, criteria=binary_classification_cross_entropy_objective, value=0.2571719970021929\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Epoch 3: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Saving model for epoch: 3\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpzgtest2y/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #progress_metric: host=algo-1, completed 26.666666666666668 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044697.7645988, \"EndTime\": 1622044698.1484814, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 3, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 360.0, \"count\": 1, \"min\": 360, \"max\": 360}, \"Total Batches Seen\": {\"sum\": 36.0, \"count\": 1, \"min\": 36, \"max\": 36}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 6.0, \"count\": 1, \"min\": 6, \"max\": 6}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=182.27794285089902 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5238588, \"EndTime\": 1622044698.5239463, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5456323419298444, \"count\": 1, \"min\": 0.5456323419298444, \"max\": 0.5456323419298444}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5240517, \"EndTime\": 1622044698.5240731, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5366126673562186, \"count\": 1, \"min\": 0.5366126673562186, \"max\": 0.5366126673562186}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5241275, \"EndTime\": 1622044698.5241446, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5826389244624547, \"count\": 1, \"min\": 0.5826389244624547, \"max\": 0.5826389244624547}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5241964, \"EndTime\": 1622044698.52426, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5348809719085693, \"count\": 1, \"min\": 0.5348809719085693, \"max\": 0.5348809719085693}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5243134, \"EndTime\": 1622044698.5243297, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2620345456259591, \"count\": 1, \"min\": 0.2620345456259591, \"max\": 0.2620345456259591}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5243802, \"EndTime\": 1622044698.5243943, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.26110974975994655, \"count\": 1, \"min\": 0.26110974975994655, \"max\": 0.26110974975994655}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5245726, \"EndTime\": 1622044698.5245907, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.26357624871390206, \"count\": 1, \"min\": 0.26357624871390206, \"max\": 0.26357624871390206}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5246487, \"EndTime\": 1622044698.5246615, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.260767240183694, \"count\": 1, \"min\": 0.260767240183694, \"max\": 0.260767240183694}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5247045, \"EndTime\": 1622044698.524717, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5707489694867816, \"count\": 1, \"min\": 0.5707489694867816, \"max\": 0.5707489694867816}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5247583, \"EndTime\": 1622044698.52484, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5632220472608294, \"count\": 1, \"min\": 0.5632220472608294, \"max\": 0.5632220472608294}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5249548, \"EndTime\": 1622044698.5249717, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5310180391584124, \"count\": 1, \"min\": 0.5310180391584124, \"max\": 0.5310180391584124}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5250177, \"EndTime\": 1622044698.52503, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5476414680480957, \"count\": 1, \"min\": 0.5476414680480957, \"max\": 0.5476414680480957}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.525071, \"EndTime\": 1622044698.5250819, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.265205158506121, \"count\": 1, \"min\": 0.265205158506121, \"max\": 0.265205158506121}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5251203, \"EndTime\": 1622044698.5251312, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2652564755507878, \"count\": 1, \"min\": 0.2652564755507878, \"max\": 0.2652564755507878}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5251691, \"EndTime\": 1622044698.5251799, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2648888511317117, \"count\": 1, \"min\": 0.2648888511317117, \"max\": 0.2648888511317117}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5253785, \"EndTime\": 1622044698.5253968, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2649901006902967, \"count\": 1, \"min\": 0.2649901006902967, \"max\": 0.2649901006902967}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5254495, \"EndTime\": 1622044698.5254664, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5551369053976877, \"count\": 1, \"min\": 0.5551369053976877, \"max\": 0.5551369053976877}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5255187, \"EndTime\": 1622044698.5255353, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5522685595921107, \"count\": 1, \"min\": 0.5522685595921107, \"max\": 0.5522685595921107}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5257025, \"EndTime\": 1622044698.525721, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5700267723628453, \"count\": 1, \"min\": 0.5700267723628453, \"max\": 0.5700267723628453}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.525774, \"EndTime\": 1622044698.5257897, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5902329513004848, \"count\": 1, \"min\": 0.5902329513004848, \"max\": 0.5902329513004848}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.525833, \"EndTime\": 1622044698.5259397, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5188340187072754, \"count\": 1, \"min\": 0.5188340187072754, \"max\": 0.5188340187072754}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5259936, \"EndTime\": 1622044698.526008, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5237454618726458, \"count\": 1, \"min\": 0.5237454618726458, \"max\": 0.5237454618726458}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5260499, \"EndTime\": 1622044698.5260615, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5207620825086321, \"count\": 1, \"min\": 0.5207620825086321, \"max\": 0.5207620825086321}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5261016, \"EndTime\": 1622044698.5261667, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5208292552403041, \"count\": 1, \"min\": 0.5208292552403041, \"max\": 0.5208292552403041}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5262892, \"EndTime\": 1622044698.5263047, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6681159700666155, \"count\": 1, \"min\": 0.6681159700666155, \"max\": 0.6681159700666155}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.52635, \"EndTime\": 1622044698.5263631, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6696227073669434, \"count\": 1, \"min\": 0.6696227073669434, \"max\": 0.6696227073669434}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5264032, \"EndTime\": 1622044698.5264146, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6711253711155483, \"count\": 1, \"min\": 0.6711253711155483, \"max\": 0.6711253711155483}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5265481, \"EndTime\": 1622044698.5265646, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6676735809871128, \"count\": 1, \"min\": 0.6676735809871128, \"max\": 0.6676735809871128}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5266116, \"EndTime\": 1622044698.5266235, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6803109509604318, \"count\": 1, \"min\": 0.6803109509604318, \"max\": 0.6803109509604318}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5266623, \"EndTime\": 1622044698.5266736, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6792022909436907, \"count\": 1, \"min\": 0.6792022909436907, \"max\": 0.6792022909436907}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5267122, \"EndTime\": 1622044698.5269017, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6819713183811733, \"count\": 1, \"min\": 0.6819713183811733, \"max\": 0.6819713183811733}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.5269673, \"EndTime\": 1622044698.526986, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6850566864013672, \"count\": 1, \"min\": 0.6850566864013672, \"max\": 0.6850566864013672}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy_objective <loss>=0.5456323419298444\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=4, criteria=binary_classification_cross_entropy_objective, value=0.260767240183694\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Saving model for epoch: 4\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpdjktseun/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #progress_metric: host=algo-1, completed 33.333333333333336 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.1487665, \"EndTime\": 1622044698.5401084, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 4, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 430.0, \"count\": 1, \"min\": 430, \"max\": 430}, \"Total Batches Seen\": {\"sum\": 43.0, \"count\": 1, \"min\": 43, \"max\": 43}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=178.69469450704887 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8530025, \"EndTime\": 1622044698.8530612, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5268048967633928, \"count\": 1, \"min\": 0.5268048967633928, \"max\": 0.5268048967633928}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.85314, \"EndTime\": 1622044698.8531556, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5179575783865792, \"count\": 1, \"min\": 0.5179575783865792, \"max\": 0.5179575783865792}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8532114, \"EndTime\": 1622044698.8532286, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.561202096939087, \"count\": 1, \"min\": 0.561202096939087, \"max\": 0.561202096939087}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8532703, \"EndTime\": 1622044698.8532808, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5163647174835205, \"count\": 1, \"min\": 0.5163647174835205, \"max\": 0.5163647174835205}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8533254, \"EndTime\": 1622044698.8533406, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2511617200715201, \"count\": 1, \"min\": 0.2511617200715201, \"max\": 0.2511617200715201}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8533914, \"EndTime\": 1622044698.8534064, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24985333851405553, \"count\": 1, \"min\": 0.24985333851405553, \"max\": 0.24985333851405553}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.853456, \"EndTime\": 1622044698.8534713, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2524860305445535, \"count\": 1, \"min\": 0.2524860305445535, \"max\": 0.2524860305445535}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8535204, \"EndTime\": 1622044698.8535357, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24968185680253166, \"count\": 1, \"min\": 0.24968185680253166, \"max\": 0.24968185680253166}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8535838, \"EndTime\": 1622044698.8535995, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5501574720655169, \"count\": 1, \"min\": 0.5501574720655169, \"max\": 0.5501574720655169}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.85365, \"EndTime\": 1622044698.8536663, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.54261200768607, \"count\": 1, \"min\": 0.54261200768607, \"max\": 0.54261200768607}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.853721, \"EndTime\": 1622044698.853738, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5132197993142265, \"count\": 1, \"min\": 0.5132197993142265, \"max\": 0.5132197993142265}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.853797, \"EndTime\": 1622044698.8538144, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5282500743865967, \"count\": 1, \"min\": 0.5282500743865967, \"max\": 0.5282500743865967}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8538768, \"EndTime\": 1622044698.8538935, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25432276555470057, \"count\": 1, \"min\": 0.25432276555470057, \"max\": 0.25432276555470057}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8539433, \"EndTime\": 1622044698.8539598, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25380280017852785, \"count\": 1, \"min\": 0.25380280017852785, \"max\": 0.25380280017852785}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.854004, \"EndTime\": 1622044698.854019, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2539560062544686, \"count\": 1, \"min\": 0.2539560062544686, \"max\": 0.2539560062544686}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8540678, \"EndTime\": 1622044698.854078, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25357752612658907, \"count\": 1, \"min\": 0.25357752612658907, \"max\": 0.25357752612658907}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8541217, \"EndTime\": 1622044698.854137, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5418080874851772, \"count\": 1, \"min\": 0.5418080874851772, \"max\": 0.5418080874851772}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8541868, \"EndTime\": 1622044698.854203, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.539087894984654, \"count\": 1, \"min\": 0.539087894984654, \"max\": 0.539087894984654}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.854248, \"EndTime\": 1622044698.854262, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5546428884778704, \"count\": 1, \"min\": 0.5546428884778704, \"max\": 0.5546428884778704}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8542924, \"EndTime\": 1622044698.8543007, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5725783552442278, \"count\": 1, \"min\": 0.5725783552442278, \"max\": 0.5725783552442278}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.854337, \"EndTime\": 1622044698.8543472, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5298930849347796, \"count\": 1, \"min\": 0.5298930849347796, \"max\": 0.5298930849347796}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8543968, \"EndTime\": 1622044698.8544114, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5257452351706369, \"count\": 1, \"min\": 0.5257452351706369, \"max\": 0.5257452351706369}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.854464, \"EndTime\": 1622044698.8544793, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5281971182141986, \"count\": 1, \"min\": 0.5281971182141986, \"max\": 0.5281971182141986}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8545308, \"EndTime\": 1622044698.8545458, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5284027985164097, \"count\": 1, \"min\": 0.5284027985164097, \"max\": 0.5284027985164097}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8546, \"EndTime\": 1622044698.854616, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6714198453085763, \"count\": 1, \"min\": 0.6714198453085763, \"max\": 0.6714198453085763}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8546672, \"EndTime\": 1622044698.8546815, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.671491847719465, \"count\": 1, \"min\": 0.671491847719465, \"max\": 0.671491847719465}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8547277, \"EndTime\": 1622044698.8547428, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6696625300816127, \"count\": 1, \"min\": 0.6696625300816127, \"max\": 0.6696625300816127}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.854815, \"EndTime\": 1622044698.8548312, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6715884685516358, \"count\": 1, \"min\": 0.6715884685516358, \"max\": 0.6715884685516358}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8548818, \"EndTime\": 1622044698.8548968, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6744497162955148, \"count\": 1, \"min\": 0.6744497162955148, \"max\": 0.6744497162955148}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.854948, \"EndTime\": 1622044698.8549638, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6767190252031599, \"count\": 1, \"min\": 0.6767190252031599, \"max\": 0.6767190252031599}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8550134, \"EndTime\": 1622044698.8550284, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6734996591295515, \"count\": 1, \"min\": 0.6734996591295515, \"max\": 0.6734996591295515}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8550758, \"EndTime\": 1622044698.8550901, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6739936079297747, \"count\": 1, \"min\": 0.6739936079297747, \"max\": 0.6739936079297747}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy_objective <loss>=0.5268048967633928\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=5, criteria=binary_classification_cross_entropy_objective, value=0.24968185680253166\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Epoch 5: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Saving model for epoch: 5\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] Saved checkpoint to \"/tmp/tmp6b_zacxz/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #progress_metric: host=algo-1, completed 40.0 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.540805, \"EndTime\": 1622044698.863904, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 5, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 500.0, \"count\": 1, \"min\": 500, \"max\": 500}, \"Total Batches Seen\": {\"sum\": 50.0, \"count\": 1, \"min\": 50, \"max\": 50}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 8.0, \"count\": 1, \"min\": 8, \"max\": 8}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:18 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=216.5726640165645 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1203086, \"EndTime\": 1622044699.1203616, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.509756258555821, \"count\": 1, \"min\": 0.509756258555821, \"max\": 0.509756258555821}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.120435, \"EndTime\": 1622044699.120449, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5009901898247855, \"count\": 1, \"min\": 0.5009901898247855, \"max\": 0.5009901898247855}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.120515, \"EndTime\": 1622044699.1205332, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5417641435350691, \"count\": 1, \"min\": 0.5417641435350691, \"max\": 0.5417641435350691}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1205885, \"EndTime\": 1622044699.1206002, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.49952232837677, \"count\": 1, \"min\": 0.49952232837677, \"max\": 0.49952232837677}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1207438, \"EndTime\": 1622044699.1207623, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24446813889912197, \"count\": 1, \"min\": 0.24446813889912197, \"max\": 0.24446813889912197}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1208174, \"EndTime\": 1622044699.1208327, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24354975393840245, \"count\": 1, \"min\": 0.24354975393840245, \"max\": 0.24354975393840245}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1208842, \"EndTime\": 1622044699.1208954, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24570144329752241, \"count\": 1, \"min\": 0.24570144329752241, \"max\": 0.24570144329752241}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1209407, \"EndTime\": 1622044699.1209552, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24337794695581708, \"count\": 1, \"min\": 0.24337794695581708, \"max\": 0.24337794695581708}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1210082, \"EndTime\": 1622044699.1210248, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5315109934125628, \"count\": 1, \"min\": 0.5315109934125628, \"max\": 0.5315109934125628}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1210778, \"EndTime\": 1622044699.1210942, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5238720076424735, \"count\": 1, \"min\": 0.5238720076424735, \"max\": 0.5238720076424735}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1211536, \"EndTime\": 1622044699.1211708, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4971266031265259, \"count\": 1, \"min\": 0.4971266031265259, \"max\": 0.4971266031265259}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1212337, \"EndTime\": 1622044699.1212611, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5106211866651262, \"count\": 1, \"min\": 0.5106211866651262, \"max\": 0.5106211866651262}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1213212, \"EndTime\": 1622044699.1213353, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25029798320361546, \"count\": 1, \"min\": 0.25029798320361546, \"max\": 0.25029798320361546}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.121388, \"EndTime\": 1622044699.121405, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25034945607185366, \"count\": 1, \"min\": 0.25034945607185366, \"max\": 0.25034945607185366}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1214654, \"EndTime\": 1622044699.1214814, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24994888475963048, \"count\": 1, \"min\": 0.24994888475963048, \"max\": 0.24994888475963048}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1215405, \"EndTime\": 1622044699.121557, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2501591682434082, \"count\": 1, \"min\": 0.2501591682434082, \"max\": 0.2501591682434082}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1216152, \"EndTime\": 1622044699.1216304, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5316085951668875, \"count\": 1, \"min\": 0.5316085951668875, \"max\": 0.5316085951668875}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1216817, \"EndTime\": 1622044699.1216984, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5291113921574184, \"count\": 1, \"min\": 0.5291113921574184, \"max\": 0.5291113921574184}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1217525, \"EndTime\": 1622044699.121768, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5423969200679234, \"count\": 1, \"min\": 0.5423969200679234, \"max\": 0.5423969200679234}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.121828, \"EndTime\": 1622044699.1218452, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.558029317855835, \"count\": 1, \"min\": 0.558029317855835, \"max\": 0.558029317855835}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1219027, \"EndTime\": 1622044699.1219196, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5122865676879883, \"count\": 1, \"min\": 0.5122865676879883, \"max\": 0.5122865676879883}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1219785, \"EndTime\": 1622044699.1219952, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.514409807750157, \"count\": 1, \"min\": 0.514409807750157, \"max\": 0.514409807750157}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.122051, \"EndTime\": 1622044699.122068, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5130437578473772, \"count\": 1, \"min\": 0.5130437578473772, \"max\": 0.5130437578473772}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1221266, \"EndTime\": 1622044699.1221437, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5129010541098459, \"count\": 1, \"min\": 0.5129010541098459, \"max\": 0.5129010541098459}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.122195, \"EndTime\": 1622044699.12221, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6723668030330113, \"count\": 1, \"min\": 0.6723668030330113, \"max\": 0.6723668030330113}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.122265, \"EndTime\": 1622044699.122279, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6717237200055803, \"count\": 1, \"min\": 0.6717237200055803, \"max\": 0.6717237200055803}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1223245, \"EndTime\": 1622044699.1223404, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6697763102395194, \"count\": 1, \"min\": 0.6697763102395194, \"max\": 0.6697763102395194}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1223996, \"EndTime\": 1622044699.1224165, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6717922006334577, \"count\": 1, \"min\": 0.6717922006334577, \"max\": 0.6717922006334577}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1224775, \"EndTime\": 1622044699.1224942, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6784639290400913, \"count\": 1, \"min\": 0.6784639290400913, \"max\": 0.6784639290400913}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1225462, \"EndTime\": 1622044699.1225626, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6788594790867397, \"count\": 1, \"min\": 0.6788594790867397, \"max\": 0.6788594790867397}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1226127, \"EndTime\": 1622044699.1226282, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6780952113015312, \"count\": 1, \"min\": 0.6780952113015312, \"max\": 0.6780952113015312}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1226754, \"EndTime\": 1622044699.1226861, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6776771068572998, \"count\": 1, \"min\": 0.6776771068572998, \"max\": 0.6776771068572998}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy_objective <loss>=0.509756258555821\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=6, criteria=binary_classification_cross_entropy_objective, value=0.24337794695581708\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Epoch 6: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saving model for epoch: 6\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpxye_8o3u/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #progress_metric: host=algo-1, completed 46.666666666666664 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044698.8641448, \"EndTime\": 1622044699.1319375, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 6, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 570.0, \"count\": 1, \"min\": 570, \"max\": 570}, \"Total Batches Seen\": {\"sum\": 57.0, \"count\": 1, \"min\": 57, \"max\": 57}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 9.0, \"count\": 1, \"min\": 9, \"max\": 9}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=261.2847929531727 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3784363, \"EndTime\": 1622044699.3785007, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.49440183980124336, \"count\": 1, \"min\": 0.49440183980124336, \"max\": 0.49440183980124336}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3785846, \"EndTime\": 1622044699.3786013, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4856785944529942, \"count\": 1, \"min\": 0.4856785944529942, \"max\": 0.4856785944529942}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.378657, \"EndTime\": 1622044699.3786743, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5242222717830113, \"count\": 1, \"min\": 0.5242222717830113, \"max\": 0.5242222717830113}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3787298, \"EndTime\": 1622044699.3787463, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4843216385160174, \"count\": 1, \"min\": 0.4843216385160174, \"max\": 0.4843216385160174}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3788188, \"EndTime\": 1622044699.3788364, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24660155006817408, \"count\": 1, \"min\": 0.24660155006817408, \"max\": 0.24660155006817408}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3788888, \"EndTime\": 1622044699.3789058, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2460263626916068, \"count\": 1, \"min\": 0.2460263626916068, \"max\": 0.2460263626916068}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3789616, \"EndTime\": 1622044699.378978, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2477293048586164, \"count\": 1, \"min\": 0.2477293048586164, \"max\": 0.2477293048586164}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3790295, \"EndTime\": 1622044699.3790443, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24585901073047092, \"count\": 1, \"min\": 0.24585901073047092, \"max\": 0.24585901073047092}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.379102, \"EndTime\": 1622044699.3791187, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5147117137908935, \"count\": 1, \"min\": 0.5147117137908935, \"max\": 0.5147117137908935}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3791773, \"EndTime\": 1622044699.3791947, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.506965616771153, \"count\": 1, \"min\": 0.506965616771153, \"max\": 0.506965616771153}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3792477, \"EndTime\": 1622044699.379264, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.48265748023986815, \"count\": 1, \"min\": 0.48265748023986815, \"max\": 0.48265748023986815}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3793144, \"EndTime\": 1622044699.3793297, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.49471770014081684, \"count\": 1, \"min\": 0.49471770014081684, \"max\": 0.49471770014081684}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3793902, \"EndTime\": 1622044699.3794096, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2539043554237911, \"count\": 1, \"min\": 0.2539043554237911, \"max\": 0.2539043554237911}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.379467, \"EndTime\": 1622044699.379483, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2539904883929661, \"count\": 1, \"min\": 0.2539904883929661, \"max\": 0.2539904883929661}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3795342, \"EndTime\": 1622044699.37955, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25350373217037747, \"count\": 1, \"min\": 0.25350373217037747, \"max\": 0.25350373217037747}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.379598, \"EndTime\": 1622044699.3796134, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2538081807749612, \"count\": 1, \"min\": 0.2538081807749612, \"max\": 0.2538081807749612}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3796508, \"EndTime\": 1622044699.3796654, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5242356709071568, \"count\": 1, \"min\": 0.5242356709071568, \"max\": 0.5242356709071568}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.379712, \"EndTime\": 1622044699.3797276, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5220629215240479, \"count\": 1, \"min\": 0.5220629215240479, \"max\": 0.5220629215240479}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3797758, \"EndTime\": 1622044699.379791, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5330269609178816, \"count\": 1, \"min\": 0.5330269609178816, \"max\": 0.5330269609178816}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.379841, \"EndTime\": 1622044699.379857, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5463924067361015, \"count\": 1, \"min\": 0.5463924067361015, \"max\": 0.5463924067361015}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3799057, \"EndTime\": 1622044699.379922, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5241803509848458, \"count\": 1, \"min\": 0.5241803509848458, \"max\": 0.5241803509848458}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3799684, \"EndTime\": 1622044699.3799844, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5252769810812814, \"count\": 1, \"min\": 0.5252769810812814, \"max\": 0.5252769810812814}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3800266, \"EndTime\": 1622044699.380042, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5244664192199707, \"count\": 1, \"min\": 0.5244664192199707, \"max\": 0.5244664192199707}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3800898, \"EndTime\": 1622044699.3801045, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5254126140049525, \"count\": 1, \"min\": 0.5254126140049525, \"max\": 0.5254126140049525}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.380152, \"EndTime\": 1622044699.3801675, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6707128661019461, \"count\": 1, \"min\": 0.6707128661019461, \"max\": 0.6707128661019461}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3802166, \"EndTime\": 1622044699.3802266, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6704599789210728, \"count\": 1, \"min\": 0.6704599789210728, \"max\": 0.6704599789210728}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3802598, \"EndTime\": 1622044699.380273, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6697615555354527, \"count\": 1, \"min\": 0.6697615555354527, \"max\": 0.6697615555354527}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3803303, \"EndTime\": 1622044699.3803458, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6712784154074533, \"count\": 1, \"min\": 0.6712784154074533, \"max\": 0.6712784154074533}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3803947, \"EndTime\": 1622044699.3804092, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.67659056527274, \"count\": 1, \"min\": 0.67659056527274, \"max\": 0.67659056527274}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3804648, \"EndTime\": 1622044699.3804815, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6758941377912249, \"count\": 1, \"min\": 0.6758941377912249, \"max\": 0.6758941377912249}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3805315, \"EndTime\": 1622044699.3805451, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6769710336412702, \"count\": 1, \"min\": 0.6769710336412702, \"max\": 0.6769710336412702}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.380592, \"EndTime\": 1622044699.380608, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6771928855351039, \"count\": 1, \"min\": 0.6771928855351039, \"max\": 0.6771928855351039}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy_objective <loss>=0.49440183980124336\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=7, criteria=binary_classification_cross_entropy_objective, value=0.24585901073047092\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saving model for epoch: 7\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saved checkpoint to \"/tmp/tmprutzn6bj/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #progress_metric: host=algo-1, completed 53.333333333333336 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.1322067, \"EndTime\": 1622044699.3892407, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 7, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 640.0, \"count\": 1, \"min\": 640, \"max\": 640}, \"Total Batches Seen\": {\"sum\": 64.0, \"count\": 1, \"min\": 64, \"max\": 64}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 10.0, \"count\": 1, \"min\": 10, \"max\": 10}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=272.19807329846816 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6492944, \"EndTime\": 1622044699.6493492, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4806395326341901, \"count\": 1, \"min\": 0.4806395326341901, \"max\": 0.4806395326341901}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6494207, \"EndTime\": 1622044699.649436, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.47191275869097027, \"count\": 1, \"min\": 0.47191275869097027, \"max\": 0.47191275869097027}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6494963, \"EndTime\": 1622044699.649514, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5084815093449184, \"count\": 1, \"min\": 0.5084815093449184, \"max\": 0.5084815093449184}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6495616, \"EndTime\": 1622044699.6495776, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4706531320299421, \"count\": 1, \"min\": 0.4706531320299421, \"max\": 0.4706531320299421}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6496305, \"EndTime\": 1622044699.6496468, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24393236977713448, \"count\": 1, \"min\": 0.24393236977713448, \"max\": 0.24393236977713448}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.649702, \"EndTime\": 1622044699.6497157, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24282335724149431, \"count\": 1, \"min\": 0.24282335724149431, \"max\": 0.24282335724149431}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6497736, \"EndTime\": 1622044699.6497905, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2449989148548671, \"count\": 1, \"min\": 0.2449989148548671, \"max\": 0.2449989148548671}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6498435, \"EndTime\": 1622044699.6498601, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24269743817193168, \"count\": 1, \"min\": 0.24269743817193168, \"max\": 0.24269743817193168}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.649916, \"EndTime\": 1622044699.6499329, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4996600900377546, \"count\": 1, \"min\": 0.4996600900377546, \"max\": 0.4996600900377546}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.649994, \"EndTime\": 1622044699.650012, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.491784702028547, \"count\": 1, \"min\": 0.491784702028547, \"max\": 0.491784702028547}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6500642, \"EndTime\": 1622044699.6500804, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4697084597178868, \"count\": 1, \"min\": 0.4697084597178868, \"max\": 0.4697084597178868}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.650133, \"EndTime\": 1622044699.6501586, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.48043012619018555, \"count\": 1, \"min\": 0.48043012619018555, \"max\": 0.48043012619018555}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.650199, \"EndTime\": 1622044699.6502128, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2514658655439104, \"count\": 1, \"min\": 0.2514658655439104, \"max\": 0.2514658655439104}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6502638, \"EndTime\": 1622044699.6502783, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25105994599206105, \"count\": 1, \"min\": 0.25105994599206105, \"max\": 0.25105994599206105}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6503294, \"EndTime\": 1622044699.6503453, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2510874671595437, \"count\": 1, \"min\": 0.2510874671595437, \"max\": 0.2510874671595437}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.650394, \"EndTime\": 1622044699.6504085, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2509029081889561, \"count\": 1, \"min\": 0.2509029081889561, \"max\": 0.2509029081889561}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6504586, \"EndTime\": 1622044699.650475, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5192897115434919, \"count\": 1, \"min\": 0.5192897115434919, \"max\": 0.5192897115434919}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.650526, \"EndTime\": 1622044699.6505408, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5175136838640485, \"count\": 1, \"min\": 0.5175136838640485, \"max\": 0.5175136838640485}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6505897, \"EndTime\": 1622044699.650605, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5261966637202672, \"count\": 1, \"min\": 0.5261966637202672, \"max\": 0.5261966637202672}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6506422, \"EndTime\": 1622044699.6506555, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5373792852674212, \"count\": 1, \"min\": 0.5373792852674212, \"max\": 0.5373792852674212}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6507022, \"EndTime\": 1622044699.6507182, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5198569910866874, \"count\": 1, \"min\": 0.5198569910866874, \"max\": 0.5198569910866874}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6507885, \"EndTime\": 1622044699.6508067, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5180467060634069, \"count\": 1, \"min\": 0.5180467060634069, \"max\": 0.5180467060634069}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.650854, \"EndTime\": 1622044699.6508696, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5191578592572893, \"count\": 1, \"min\": 0.5191578592572893, \"max\": 0.5191578592572893}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6509194, \"EndTime\": 1622044699.650936, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5185972690582276, \"count\": 1, \"min\": 0.5185972690582276, \"max\": 0.5185972690582276}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6509848, \"EndTime\": 1622044699.6509998, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6698599747249059, \"count\": 1, \"min\": 0.6698599747249059, \"max\": 0.6698599747249059}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6510506, \"EndTime\": 1622044699.6510665, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6699730396270752, \"count\": 1, \"min\": 0.6699730396270752, \"max\": 0.6699730396270752}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6511176, \"EndTime\": 1622044699.6511328, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6704147611345563, \"count\": 1, \"min\": 0.6704147611345563, \"max\": 0.6704147611345563}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6511824, \"EndTime\": 1622044699.6511972, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6700238568442208, \"count\": 1, \"min\": 0.6700238568442208, \"max\": 0.6700238568442208}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6512425, \"EndTime\": 1622044699.6512582, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6769453866141183, \"count\": 1, \"min\": 0.6769453866141183, \"max\": 0.6769453866141183}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6513035, \"EndTime\": 1622044699.6513186, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6773716858455113, \"count\": 1, \"min\": 0.6773716858455113, \"max\": 0.6773716858455113}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6513743, \"EndTime\": 1622044699.6513908, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6768890653337751, \"count\": 1, \"min\": 0.6768890653337751, \"max\": 0.6768890653337751}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6514428, \"EndTime\": 1622044699.6514587, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6776342596326556, \"count\": 1, \"min\": 0.6776342596326556, \"max\": 0.6776342596326556}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy_objective <loss>=0.4806395326341901\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=8, criteria=binary_classification_cross_entropy_objective, value=0.24269743817193168\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Epoch 8: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saving model for epoch: 8\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saved checkpoint to \"/tmp/tmphyabt5gx/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #progress_metric: host=algo-1, completed 60.0 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.3895063, \"EndTime\": 1622044699.6604638, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 8, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 710.0, \"count\": 1, \"min\": 710, \"max\": 710}, \"Total Batches Seen\": {\"sum\": 71.0, \"count\": 1, \"min\": 71, \"max\": 71}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 11.0, \"count\": 1, \"min\": 11, \"max\": 11}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=258.21838883333464 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.923656, \"EndTime\": 1622044699.9237087, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4682771580559867, \"count\": 1, \"min\": 0.4682771580559867, \"max\": 0.4682771580559867}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.923781, \"EndTime\": 1622044699.9237952, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4595074278967721, \"count\": 1, \"min\": 0.4595074278967721, \"max\": 0.4595074278967721}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9238307, \"EndTime\": 1622044699.9238446, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.49434737137385776, \"count\": 1, \"min\": 0.49434737137385776, \"max\": 0.49434737137385776}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9239025, \"EndTime\": 1622044699.923918, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4583326816558838, \"count\": 1, \"min\": 0.4583326816558838, \"max\": 0.4583326816558838}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9239717, \"EndTime\": 1622044699.9239883, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2404209860733577, \"count\": 1, \"min\": 0.2404209860733577, \"max\": 0.2404209860733577}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9240408, \"EndTime\": 1622044699.9240572, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2394771090575627, \"count\": 1, \"min\": 0.2394771090575627, \"max\": 0.2394771090575627}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.92411, \"EndTime\": 1622044699.9241261, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2414529187338693, \"count\": 1, \"min\": 0.2414529187338693, \"max\": 0.2414529187338693}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9241762, \"EndTime\": 1622044699.9241922, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23933536410331727, \"count\": 1, \"min\": 0.23933536410331727, \"max\": 0.23933536410331727}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9242458, \"EndTime\": 1622044699.9242618, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.48615952219281877, \"count\": 1, \"min\": 0.48615952219281877, \"max\": 0.48615952219281877}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9243133, \"EndTime\": 1622044699.9243298, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4781367029462542, \"count\": 1, \"min\": 0.4781367029462542, \"max\": 0.4781367029462542}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9243817, \"EndTime\": 1622044699.9243984, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4580898080553327, \"count\": 1, \"min\": 0.4580898080553327, \"max\": 0.4580898080553327}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9244494, \"EndTime\": 1622044699.9244761, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4675710678100586, \"count\": 1, \"min\": 0.4675710678100586, \"max\": 0.4675710678100586}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9245274, \"EndTime\": 1622044699.9245427, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25055641106196813, \"count\": 1, \"min\": 0.25055641106196813, \"max\": 0.25055641106196813}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9245896, \"EndTime\": 1622044699.9246016, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25072879024914335, \"count\": 1, \"min\": 0.25072879024914335, \"max\": 0.25072879024914335}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9246511, \"EndTime\": 1622044699.924662, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2501890071800777, \"count\": 1, \"min\": 0.2501890071800777, \"max\": 0.2501890071800777}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9247162, \"EndTime\": 1622044699.924732, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2505986213684082, \"count\": 1, \"min\": 0.2505986213684082, \"max\": 0.2505986213684082}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.924781, \"EndTime\": 1622044699.9247973, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5162609849657331, \"count\": 1, \"min\": 0.5162609849657331, \"max\": 0.5162609849657331}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.924844, \"EndTime\": 1622044699.92486, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5149187088012696, \"count\": 1, \"min\": 0.5149187088012696, \"max\": 0.5149187088012696}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9249153, \"EndTime\": 1622044699.92493, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5214573792048863, \"count\": 1, \"min\": 0.5214573792048863, \"max\": 0.5214573792048863}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.924978, \"EndTime\": 1622044699.924993, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5305982521602086, \"count\": 1, \"min\": 0.5305982521602086, \"max\": 0.5305982521602086}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9250374, \"EndTime\": 1622044699.9250498, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5181438377925328, \"count\": 1, \"min\": 0.5181438377925328, \"max\": 0.5181438377925328}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9250948, \"EndTime\": 1622044699.9251099, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5209428242274693, \"count\": 1, \"min\": 0.5209428242274693, \"max\": 0.5209428242274693}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.925159, \"EndTime\": 1622044699.9251745, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5188657760620117, \"count\": 1, \"min\": 0.5188657760620117, \"max\": 0.5188657760620117}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.925223, \"EndTime\": 1622044699.9252381, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5200532163892474, \"count\": 1, \"min\": 0.5200532163892474, \"max\": 0.5200532163892474}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9252849, \"EndTime\": 1622044699.9252985, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6701217583247594, \"count\": 1, \"min\": 0.6701217583247594, \"max\": 0.6701217583247594}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9253478, \"EndTime\": 1622044699.9253616, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6701572758810861, \"count\": 1, \"min\": 0.6701572758810861, \"max\": 0.6701572758810861}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.92541, \"EndTime\": 1622044699.9254246, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6708844116755894, \"count\": 1, \"min\": 0.6708844116755894, \"max\": 0.6708844116755894}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9254718, \"EndTime\": 1622044699.9254863, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.669848666872297, \"count\": 1, \"min\": 0.669848666872297, \"max\": 0.669848666872297}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9255416, \"EndTime\": 1622044699.925558, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6771921294076102, \"count\": 1, \"min\": 0.6771921294076102, \"max\": 0.6771921294076102}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9256053, \"EndTime\": 1622044699.9256206, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6775552340916224, \"count\": 1, \"min\": 0.6775552340916224, \"max\": 0.6775552340916224}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.925668, \"EndTime\": 1622044699.9256828, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6769364561353411, \"count\": 1, \"min\": 0.6769364561353411, \"max\": 0.6769364561353411}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9257288, \"EndTime\": 1622044699.9257436, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6772739206041608, \"count\": 1, \"min\": 0.6772739206041608, \"max\": 0.6772739206041608}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy_objective <loss>=0.4682771580559867\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=9, criteria=binary_classification_cross_entropy_objective, value=0.23933536410331727\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Epoch 9: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saving model for epoch: 9\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] Saved checkpoint to \"/tmp/tmp5t5tmg3t/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #progress_metric: host=algo-1, completed 66.66666666666667 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.6607308, \"EndTime\": 1622044699.9349868, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 9, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 780.0, \"count\": 1, \"min\": 780, \"max\": 780}, \"Total Batches Seen\": {\"sum\": 78.0, \"count\": 1, \"min\": 78, \"max\": 78}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 12.0, \"count\": 1, \"min\": 12, \"max\": 12}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:19 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=255.1313060215418 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1835465, \"EndTime\": 1622044700.1835916, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4571066277367728, \"count\": 1, \"min\": 0.4571066277367728, \"max\": 0.4571066277367728}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1836624, \"EndTime\": 1622044700.1836815, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.44827479634966166, \"count\": 1, \"min\": 0.44827479634966166, \"max\": 0.44827479634966166}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.183728, \"EndTime\": 1622044700.1837437, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.48159448078700473, \"count\": 1, \"min\": 0.48159448078700473, \"max\": 0.48159448078700473}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1838024, \"EndTime\": 1622044700.18382, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4471740688596453, \"count\": 1, \"min\": 0.4471740688596453, \"max\": 0.4471740688596453}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1838822, \"EndTime\": 1622044700.1838996, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24012845839772906, \"count\": 1, \"min\": 0.24012845839772906, \"max\": 0.24012845839772906}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1839523, \"EndTime\": 1622044700.1839697, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2395031375544412, \"count\": 1, \"min\": 0.2395031375544412, \"max\": 0.2395031375544412}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1840222, \"EndTime\": 1622044700.184038, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.24111374020576476, \"count\": 1, \"min\": 0.24111374020576476, \"max\": 0.24111374020576476}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1840916, \"EndTime\": 1622044700.1841073, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23934167623519897, \"count\": 1, \"min\": 0.23934167623519897, \"max\": 0.23934167623519897}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1841488, \"EndTime\": 1622044700.1841586, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.47398784160614016, \"count\": 1, \"min\": 0.47398784160614016, \"max\": 0.47398784160614016}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1841846, \"EndTime\": 1622044700.1841938, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4658174651009696, \"count\": 1, \"min\": 0.4658174651009696, \"max\": 0.4658174651009696}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1842425, \"EndTime\": 1622044700.1842587, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.44760023525782994, \"count\": 1, \"min\": 0.44760023525782994, \"max\": 0.44760023525782994}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.184299, \"EndTime\": 1622044700.1843088, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.45594677584511895, \"count\": 1, \"min\": 0.45594677584511895, \"max\": 0.45594677584511895}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1843333, \"EndTime\": 1622044700.1843407, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25222269211496623, \"count\": 1, \"min\": 0.25222269211496623, \"max\": 0.25222269211496623}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1843643, \"EndTime\": 1622044700.1843712, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25239433561052593, \"count\": 1, \"min\": 0.25239433561052593, \"max\": 0.25239433561052593}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1843941, \"EndTime\": 1622044700.1844015, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25186755316598075, \"count\": 1, \"min\": 0.25186755316598075, \"max\": 0.25186755316598075}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.18444, \"EndTime\": 1622044700.184452, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2522777157170432, \"count\": 1, \"min\": 0.2522777157170432, \"max\": 0.2522777157170432}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1844897, \"EndTime\": 1622044700.1844969, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5146359375544957, \"count\": 1, \"min\": 0.5146359375544957, \"max\": 0.5146359375544957}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1845198, \"EndTime\": 1622044700.184527, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.513722733088902, \"count\": 1, \"min\": 0.513722733088902, \"max\": 0.513722733088902}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.184549, \"EndTime\": 1622044700.184556, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5183449336460658, \"count\": 1, \"min\": 0.5183449336460658, \"max\": 0.5183449336460658}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1845791, \"EndTime\": 1622044700.1845906, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5256339822496686, \"count\": 1, \"min\": 0.5256339822496686, \"max\": 0.5256339822496686}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1846292, \"EndTime\": 1622044700.184641, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.522520181110927, \"count\": 1, \"min\": 0.522520181110927, \"max\": 0.522520181110927}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.184678, \"EndTime\": 1622044700.184687, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5210944516318184, \"count\": 1, \"min\": 0.5210944516318184, \"max\": 0.5210944516318184}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1847107, \"EndTime\": 1622044700.184718, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5220661231449673, \"count\": 1, \"min\": 0.5220661231449673, \"max\": 0.5220661231449673}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1847405, \"EndTime\": 1622044700.1847472, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5218669142041887, \"count\": 1, \"min\": 0.5218669142041887, \"max\": 0.5218669142041887}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1847696, \"EndTime\": 1622044700.1847765, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6701399530683245, \"count\": 1, \"min\": 0.6701399530683245, \"max\": 0.6701399530683245}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.184798, \"EndTime\": 1622044700.1848075, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6705750397273472, \"count\": 1, \"min\": 0.6705750397273472, \"max\": 0.6705750397273472}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1848474, \"EndTime\": 1622044700.1848564, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6706008638654436, \"count\": 1, \"min\": 0.6706008638654436, \"max\": 0.6706008638654436}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.184896, \"EndTime\": 1622044700.1849103, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6703179836273193, \"count\": 1, \"min\": 0.6703179836273193, \"max\": 0.6703179836273193}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1849415, \"EndTime\": 1622044700.1849499, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6764134543282645, \"count\": 1, \"min\": 0.6764134543282645, \"max\": 0.6764134543282645}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1849732, \"EndTime\": 1622044700.1849804, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.677070072719029, \"count\": 1, \"min\": 0.677070072719029, \"max\": 0.677070072719029}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.185003, \"EndTime\": 1622044700.18501, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6762378352028983, \"count\": 1, \"min\": 0.6762378352028983, \"max\": 0.6762378352028983}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1850333, \"EndTime\": 1622044700.1850455, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6767260074615479, \"count\": 1, \"min\": 0.6767260074615479, \"max\": 0.6767260074615479}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy_objective <loss>=0.4571066277367728\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=10, criteria=binary_classification_cross_entropy_objective, value=0.23934167623519897\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saving model for epoch: 10\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpz_lb4trm/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #progress_metric: host=algo-1, completed 73.33333333333333 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044699.9352243, \"EndTime\": 1622044700.1925857, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 10, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 850.0, \"count\": 1, \"min\": 850, \"max\": 850}, \"Total Batches Seen\": {\"sum\": 85.0, \"count\": 1, \"min\": 85, \"max\": 85}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 13.0, \"count\": 1, \"min\": 13, \"max\": 13}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=271.85706454910445 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.444571, \"EndTime\": 1622044700.4446244, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.44697700568607873, \"count\": 1, \"min\": 0.44697700568607873, \"max\": 0.44697700568607873}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.444698, \"EndTime\": 1622044700.4447165, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.43805716378348214, \"count\": 1, \"min\": 0.43805716378348214, \"max\": 0.43805716378348214}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4447796, \"EndTime\": 1622044700.444797, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.47005282470158166, \"count\": 1, \"min\": 0.47005282470158166, \"max\": 0.47005282470158166}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4448555, \"EndTime\": 1622044700.4448729, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4370211056300572, \"count\": 1, \"min\": 0.4370211056300572, \"max\": 0.4370211056300572}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4449375, \"EndTime\": 1622044700.4449522, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23902430278914316, \"count\": 1, \"min\": 0.23902430278914316, \"max\": 0.23902430278914316}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4449997, \"EndTime\": 1622044700.4450135, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23801200985908508, \"count\": 1, \"min\": 0.23801200985908508, \"max\": 0.23801200985908508}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4450588, \"EndTime\": 1622044700.4450736, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2399893309388842, \"count\": 1, \"min\": 0.2399893309388842, \"max\": 0.2399893309388842}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.445125, \"EndTime\": 1622044700.445139, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23785031182425362, \"count\": 1, \"min\": 0.23785031182425362, \"max\": 0.23785031182425362}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4451714, \"EndTime\": 1622044700.44518, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4629791191646031, \"count\": 1, \"min\": 0.4629791191646031, \"max\": 0.4629791191646031}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4452279, \"EndTime\": 1622044700.445243, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.45465037822723386, \"count\": 1, \"min\": 0.45465037822723386, \"max\": 0.45465037822723386}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4452937, \"EndTime\": 1622044700.445309, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.43809514726911275, \"count\": 1, \"min\": 0.43809514726911275, \"max\": 0.43809514726911275}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.445361, \"EndTime\": 1622044700.445376, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.44539224079677037, \"count\": 1, \"min\": 0.44539224079677037, \"max\": 0.44539224079677037}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4454074, \"EndTime\": 1622044700.445416, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25164165922573634, \"count\": 1, \"min\": 0.25164165922573634, \"max\": 0.25164165922573634}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4454408, \"EndTime\": 1622044700.4454484, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2515510082244873, \"count\": 1, \"min\": 0.2515510082244873, \"max\": 0.2515510082244873}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4454823, \"EndTime\": 1622044700.4454892, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2513287595340184, \"count\": 1, \"min\": 0.2513287595340184, \"max\": 0.2513287595340184}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.445514, \"EndTime\": 1622044700.4455266, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25145180480820795, \"count\": 1, \"min\": 0.25145180480820795, \"max\": 0.25145180480820795}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4455626, \"EndTime\": 1622044700.4455755, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5139632974352155, \"count\": 1, \"min\": 0.5139632974352155, \"max\": 0.5139632974352155}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4456315, \"EndTime\": 1622044700.4456487, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5134305613381522, \"count\": 1, \"min\": 0.5134305613381522, \"max\": 0.5134305613381522}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4457004, \"EndTime\": 1622044700.4457161, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5164445740836007, \"count\": 1, \"min\": 0.5164445740836007, \"max\": 0.5164445740836007}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4457686, \"EndTime\": 1622044700.4457843, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5221001625061035, \"count\": 1, \"min\": 0.5221001625061035, \"max\": 0.5221001625061035}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.445833, \"EndTime\": 1622044700.4458485, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.518126494543893, \"count\": 1, \"min\": 0.518126494543893, \"max\": 0.518126494543893}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4458966, \"EndTime\": 1622044700.4459116, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5196008137294225, \"count\": 1, \"min\": 0.5196008137294225, \"max\": 0.5196008137294225}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4459617, \"EndTime\": 1622044700.4459763, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.518298305783953, \"count\": 1, \"min\": 0.518298305783953, \"max\": 0.518298305783953}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4460251, \"EndTime\": 1622044700.4460409, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5190575872148786, \"count\": 1, \"min\": 0.5190575872148786, \"max\": 0.5190575872148786}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4460998, \"EndTime\": 1622044700.4461157, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6704697677067348, \"count\": 1, \"min\": 0.6704697677067348, \"max\": 0.6704697677067348}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4461675, \"EndTime\": 1622044700.4461827, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6704829965318952, \"count\": 1, \"min\": 0.6704829965318952, \"max\": 0.6704829965318952}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4462395, \"EndTime\": 1622044700.4462547, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6700800146375384, \"count\": 1, \"min\": 0.6700800146375384, \"max\": 0.6700800146375384}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.446306, \"EndTime\": 1622044700.4463205, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.670510128566197, \"count\": 1, \"min\": 0.670510128566197, \"max\": 0.670510128566197}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4463513, \"EndTime\": 1622044700.4463596, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6770717007773263, \"count\": 1, \"min\": 0.6770717007773263, \"max\": 0.6770717007773263}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.446399, \"EndTime\": 1622044700.4464133, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6775827544076102, \"count\": 1, \"min\": 0.6775827544076102, \"max\": 0.6775827544076102}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.446458, \"EndTime\": 1622044700.4464724, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6770326478140695, \"count\": 1, \"min\": 0.6770326478140695, \"max\": 0.6770326478140695}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4465232, \"EndTime\": 1622044700.446539, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6775416237967354, \"count\": 1, \"min\": 0.6775416237967354, \"max\": 0.6775416237967354}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy_objective <loss>=0.44697700568607873\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=11, criteria=binary_classification_cross_entropy_objective, value=0.23785031182425362\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Epoch 11: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saving model for epoch: 11\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpn4jpyuuk/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #progress_metric: host=algo-1, completed 80.0 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.1928422, \"EndTime\": 1622044700.4557798, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 11, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 920.0, \"count\": 1, \"min\": 920, \"max\": 920}, \"Total Batches Seen\": {\"sum\": 92.0, \"count\": 1, \"min\": 92, \"max\": 92}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 14.0, \"count\": 1, \"min\": 14, \"max\": 14}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=266.0988948243266 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7120693, \"EndTime\": 1622044700.7121215, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4377519301005772, \"count\": 1, \"min\": 0.4377519301005772, \"max\": 0.4377519301005772}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7121952, \"EndTime\": 1622044700.7122095, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.42872511659349716, \"count\": 1, \"min\": 0.42872511659349716, \"max\": 0.42872511659349716}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.712245, \"EndTime\": 1622044700.7122593, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.45956571102142335, \"count\": 1, \"min\": 0.45956571102142335, \"max\": 0.45956571102142335}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.712309, \"EndTime\": 1622044700.712324, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4277457169124058, \"count\": 1, \"min\": 0.4277457169124058, \"max\": 0.4277457169124058}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.712378, \"EndTime\": 1622044700.7123938, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2370066693850926, \"count\": 1, \"min\": 0.2370066693850926, \"max\": 0.2370066693850926}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.712447, \"EndTime\": 1622044700.7124636, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2359785956995828, \"count\": 1, \"min\": 0.2359785956995828, \"max\": 0.2359785956995828}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7125235, \"EndTime\": 1622044700.7125404, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23794710891587392, \"count\": 1, \"min\": 0.23794710891587392, \"max\": 0.23794710891587392}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7126017, \"EndTime\": 1622044700.7126184, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2358093695981162, \"count\": 1, \"min\": 0.2358093695981162, \"max\": 0.2358093695981162}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7126787, \"EndTime\": 1622044700.7126954, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4529815980366298, \"count\": 1, \"min\": 0.4529815980366298, \"max\": 0.4529815980366298}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.712749, \"EndTime\": 1622044700.7127643, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.44448837552751813, \"count\": 1, \"min\": 0.44448837552751813, \"max\": 0.44448837552751813}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7128105, \"EndTime\": 1622044700.712824, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4294445446559361, \"count\": 1, \"min\": 0.4294445446559361, \"max\": 0.4294445446559361}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.712872, \"EndTime\": 1622044700.7128875, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.43577110086168563, \"count\": 1, \"min\": 0.43577110086168563, \"max\": 0.43577110086168563}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7129374, \"EndTime\": 1622044700.7129505, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2515568026474544, \"count\": 1, \"min\": 0.2515568026474544, \"max\": 0.2515568026474544}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.713002, \"EndTime\": 1622044700.7130163, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2518798249108451, \"count\": 1, \"min\": 0.2518798249108451, \"max\": 0.2518798249108451}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.713061, \"EndTime\": 1622044700.7130754, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25125937036105567, \"count\": 1, \"min\": 0.25125937036105567, \"max\": 0.25125937036105567}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7131252, \"EndTime\": 1622044700.7131402, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25179800902094157, \"count\": 1, \"min\": 0.25179800902094157, \"max\": 0.25179800902094157}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7131884, \"EndTime\": 1622044700.7132032, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5138665335518974, \"count\": 1, \"min\": 0.5138665335518974, \"max\": 0.5138665335518974}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7132552, \"EndTime\": 1622044700.7132666, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5136401993887765, \"count\": 1, \"min\": 0.5136401993887765, \"max\": 0.5136401993887765}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.713322, \"EndTime\": 1622044700.7133384, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5153922625950405, \"count\": 1, \"min\": 0.5153922625950405, \"max\": 0.5153922625950405}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7133865, \"EndTime\": 1622044700.7134025, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5196568420955113, \"count\": 1, \"min\": 0.5196568420955113, \"max\": 0.5196568420955113}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7134497, \"EndTime\": 1622044700.71346, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5213690280914307, \"count\": 1, \"min\": 0.5213690280914307, \"max\": 0.5213690280914307}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.713488, \"EndTime\": 1622044700.713501, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5216357299259731, \"count\": 1, \"min\": 0.5216357299259731, \"max\": 0.5216357299259731}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7135427, \"EndTime\": 1622044700.713556, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5214143821171352, \"count\": 1, \"min\": 0.5214143821171352, \"max\": 0.5214143821171352}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7136033, \"EndTime\": 1622044700.7136183, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5219077859606062, \"count\": 1, \"min\": 0.5219077859606062, \"max\": 0.5219077859606062}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7136612, \"EndTime\": 1622044700.7136767, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6704409258706229, \"count\": 1, \"min\": 0.6704409258706229, \"max\": 0.6704409258706229}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7137296, \"EndTime\": 1622044700.7137449, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6702935150691441, \"count\": 1, \"min\": 0.6702935150691441, \"max\": 0.6702935150691441}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7138026, \"EndTime\": 1622044700.7138186, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6700508866991316, \"count\": 1, \"min\": 0.6700508866991316, \"max\": 0.6700508866991316}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7138684, \"EndTime\": 1622044700.7138834, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6704636710030693, \"count\": 1, \"min\": 0.6704636710030693, \"max\": 0.6704636710030693}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7139416, \"EndTime\": 1622044700.713958, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6767558097839356, \"count\": 1, \"min\": 0.6767558097839356, \"max\": 0.6767558097839356}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.713999, \"EndTime\": 1622044700.714014, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6772235802241734, \"count\": 1, \"min\": 0.6772235802241734, \"max\": 0.6772235802241734}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7140615, \"EndTime\": 1622044700.7140758, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6767482757568359, \"count\": 1, \"min\": 0.6767482757568359, \"max\": 0.6767482757568359}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7141345, \"EndTime\": 1622044700.7141516, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.677219615663801, \"count\": 1, \"min\": 0.677219615663801, \"max\": 0.677219615663801}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy_objective <loss>=0.4377519301005772\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=12, criteria=binary_classification_cross_entropy_objective, value=0.2358093695981162\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Epoch 12: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saving model for epoch: 12\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpo_owk9vb/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #progress_metric: host=algo-1, completed 86.66666666666667 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.4560351, \"EndTime\": 1622044700.7230923, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 12, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 990.0, \"count\": 1, \"min\": 990, \"max\": 990}, \"Total Batches Seen\": {\"sum\": 99.0, \"count\": 1, \"min\": 99, \"max\": 99}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 15.0, \"count\": 1, \"min\": 15, \"max\": 15}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=261.99405518805753 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9770906, \"EndTime\": 1622044700.977147, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.42930971213749475, \"count\": 1, \"min\": 0.42930971213749475, \"max\": 0.42930971213749475}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.977225, \"EndTime\": 1622044700.9772396, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4201686177934919, \"count\": 1, \"min\": 0.4201686177934919, \"max\": 0.4201686177934919}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9772756, \"EndTime\": 1622044700.97729, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.44999284403664724, \"count\": 1, \"min\": 0.44999284403664724, \"max\": 0.44999284403664724}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9773362, \"EndTime\": 1622044700.9773507, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4192389760698591, \"count\": 1, \"min\": 0.4192389760698591, \"max\": 0.4192389760698591}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9774058, \"EndTime\": 1622044700.97742, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23596941232681273, \"count\": 1, \"min\": 0.23596941232681273, \"max\": 0.23596941232681273}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9774752, \"EndTime\": 1622044700.9774919, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23520261560167585, \"count\": 1, \"min\": 0.23520261560167585, \"max\": 0.23520261560167585}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9775543, \"EndTime\": 1622044700.9775705, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23687380978039332, \"count\": 1, \"min\": 0.23687380978039332, \"max\": 0.23687380978039332}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9776325, \"EndTime\": 1622044700.97765, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23502347128731862, \"count\": 1, \"min\": 0.23502347128731862, \"max\": 0.23502347128731862}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9777112, \"EndTime\": 1622044700.9777272, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4438598190035139, \"count\": 1, \"min\": 0.4438598190035139, \"max\": 0.4438598190035139}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9777875, \"EndTime\": 1622044700.9778032, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.43520586150033136, \"count\": 1, \"min\": 0.43520586150033136, \"max\": 0.43520586150033136}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.977855, \"EndTime\": 1622044700.9778707, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4215325491768973, \"count\": 1, \"min\": 0.4215325491768973, \"max\": 0.4215325491768973}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9779253, \"EndTime\": 1622044700.9779396, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.42696732112339564, \"count\": 1, \"min\": 0.42696732112339564, \"max\": 0.42696732112339564}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9779866, \"EndTime\": 1622044700.9780004, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25207186170986723, \"count\": 1, \"min\": 0.25207186170986723, \"max\": 0.25207186170986723}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.978053, \"EndTime\": 1622044700.978065, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2523135917527335, \"count\": 1, \"min\": 0.2523135917527335, \"max\": 0.2523135917527335}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.978105, \"EndTime\": 1622044700.9781191, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25181334018707274, \"count\": 1, \"min\": 0.25181334018707274, \"max\": 0.25181334018707274}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9781682, \"EndTime\": 1622044700.978184, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2522425779274532, \"count\": 1, \"min\": 0.2522425779274532, \"max\": 0.2522425779274532}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9782288, \"EndTime\": 1622044700.978239, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5140649114336286, \"count\": 1, \"min\": 0.5140649114336286, \"max\": 0.5140649114336286}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9782646, \"EndTime\": 1622044700.9782717, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5140558923993792, \"count\": 1, \"min\": 0.5140558923993792, \"max\": 0.5140558923993792}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9783165, \"EndTime\": 1622044700.978332, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5148950713021415, \"count\": 1, \"min\": 0.5148950713021415, \"max\": 0.5148950713021415}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9783866, \"EndTime\": 1622044700.9784036, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5180153369903564, \"count\": 1, \"min\": 0.5180153369903564, \"max\": 0.5180153369903564}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9784548, \"EndTime\": 1622044700.9784698, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5196195738656181, \"count\": 1, \"min\": 0.5196195738656181, \"max\": 0.5196195738656181}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9785268, \"EndTime\": 1622044700.9785435, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5199548857552665, \"count\": 1, \"min\": 0.5199548857552665, \"max\": 0.5199548857552665}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9785974, \"EndTime\": 1622044700.9786136, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5194982256208147, \"count\": 1, \"min\": 0.5194982256208147, \"max\": 0.5194982256208147}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9786634, \"EndTime\": 1622044700.9786792, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5198398317609515, \"count\": 1, \"min\": 0.5198398317609515, \"max\": 0.5198398317609515}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9787261, \"EndTime\": 1622044700.9787412, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6701746055058071, \"count\": 1, \"min\": 0.6701746055058071, \"max\": 0.6701746055058071}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9788065, \"EndTime\": 1622044700.9788172, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6702375888824463, \"count\": 1, \"min\": 0.6702375888824463, \"max\": 0.6702375888824463}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9788437, \"EndTime\": 1622044700.9788513, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6703317778451102, \"count\": 1, \"min\": 0.6703317778451102, \"max\": 0.6703317778451102}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9788976, \"EndTime\": 1622044700.978914, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6702181475503104, \"count\": 1, \"min\": 0.6702181475503104, \"max\": 0.6702181475503104}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.978974, \"EndTime\": 1622044700.97899, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6768102850232806, \"count\": 1, \"min\": 0.6768102850232806, \"max\": 0.6768102850232806}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.97904, \"EndTime\": 1622044700.9790545, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6774762834821428, \"count\": 1, \"min\": 0.6774762834821428, \"max\": 0.6774762834821428}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9791043, \"EndTime\": 1622044700.979119, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6767825058528355, \"count\": 1, \"min\": 0.6767825058528355, \"max\": 0.6767825058528355}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.979168, \"EndTime\": 1622044700.979183, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6774696622576032, \"count\": 1, \"min\": 0.6774696622576032, \"max\": 0.6774696622576032}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy_objective <loss>=0.42930971213749475\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=13, criteria=binary_classification_cross_entropy_objective, value=0.23502347128731862\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Epoch 13: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saving model for epoch: 13\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpgb1z5kbu/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #progress_metric: host=algo-1, completed 93.33333333333333 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.7233467, \"EndTime\": 1622044700.988443, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 13, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1060.0, \"count\": 1, \"min\": 1060, \"max\": 1060}, \"Total Batches Seen\": {\"sum\": 106.0, \"count\": 1, \"min\": 106, \"max\": 106}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 16.0, \"count\": 1, \"min\": 16, \"max\": 16}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:20 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=263.94946145015143 records/second\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2386289, \"EndTime\": 1622044701.2386832, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 0}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.42155331884111674, \"count\": 1, \"min\": 0.42155331884111674, \"max\": 0.42155331884111674}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.238784, \"EndTime\": 1622044701.2388067, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 1}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.41230391434260777, \"count\": 1, \"min\": 0.41230391434260777, \"max\": 0.41230391434260777}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.238863, \"EndTime\": 1622044701.23888, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 2}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4412208012172154, \"count\": 1, \"min\": 0.4412208012172154, \"max\": 0.4412208012172154}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2389376, \"EndTime\": 1622044701.2389548, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 3}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4114180871418544, \"count\": 1, \"min\": 0.4114180871418544, \"max\": 0.4114180871418544}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2390137, \"EndTime\": 1622044701.239031, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 4}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2350735834666661, \"count\": 1, \"min\": 0.2350735834666661, \"max\": 0.2350735834666661}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2390873, \"EndTime\": 1622044701.2391047, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 5}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23403241974966868, \"count\": 1, \"min\": 0.23403241974966868, \"max\": 0.23403241974966868}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2391546, \"EndTime\": 1622044701.2391696, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 6}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2359589832169669, \"count\": 1, \"min\": 0.2359589832169669, \"max\": 0.2359589832169669}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.23922, \"EndTime\": 1622044701.239236, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 7}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.23384656650679453, \"count\": 1, \"min\": 0.23384656650679453, \"max\": 0.23384656650679453}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2392888, \"EndTime\": 1622044701.2393048, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 8}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4355045557022095, \"count\": 1, \"min\": 0.4355045557022095, \"max\": 0.4355045557022095}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2393591, \"EndTime\": 1622044701.2393756, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 9}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.42670677730015344, \"count\": 1, \"min\": 0.42670677730015344, \"max\": 0.42670677730015344}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2394273, \"EndTime\": 1622044701.2394433, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 10}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.41426728112357003, \"count\": 1, \"min\": 0.41426728112357003, \"max\": 0.41426728112357003}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2395062, \"EndTime\": 1622044701.2395213, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 11}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.4188924176352365, \"count\": 1, \"min\": 0.4188924176352365, \"max\": 0.4188924176352365}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2395859, \"EndTime\": 1622044701.2396023, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 12}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.25178428036825995, \"count\": 1, \"min\": 0.25178428036825995, \"max\": 0.25178428036825995}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2396533, \"EndTime\": 1622044701.2396698, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 13}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2518861906869071, \"count\": 1, \"min\": 0.2518861906869071, \"max\": 0.2518861906869071}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2397187, \"EndTime\": 1622044701.239735, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 14}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2515717463833945, \"count\": 1, \"min\": 0.2515717463833945, \"max\": 0.2515717463833945}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.239791, \"EndTime\": 1622044701.2398088, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 15}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.2518272876739502, \"count\": 1, \"min\": 0.2518272876739502, \"max\": 0.2518272876739502}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.239861, \"EndTime\": 1622044701.2398775, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 16}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5143681866782052, \"count\": 1, \"min\": 0.5143681866782052, \"max\": 0.5143681866782052}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2399392, \"EndTime\": 1622044701.2399564, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 17}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5144838946206229, \"count\": 1, \"min\": 0.5144838946206229, \"max\": 0.5144838946206229}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2400026, \"EndTime\": 1622044701.2400177, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 18}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5147313322339739, \"count\": 1, \"min\": 0.5147313322339739, \"max\": 0.5147313322339739}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2400632, \"EndTime\": 1622044701.2400768, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 19}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5169401986258371, \"count\": 1, \"min\": 0.5169401986258371, \"max\": 0.5169401986258371}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.240125, \"EndTime\": 1622044701.2401414, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 20}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5201952525547573, \"count\": 1, \"min\": 0.5201952525547573, \"max\": 0.5201952525547573}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2401905, \"EndTime\": 1622044701.2402034, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 21}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.5212232453482492, \"count\": 1, \"min\": 0.5212232453482492, \"max\": 0.5212232453482492}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2402394, \"EndTime\": 1622044701.240254, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 22}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.520329305103847, \"count\": 1, \"min\": 0.520329305103847, \"max\": 0.520329305103847}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2402952, \"EndTime\": 1622044701.2403107, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 23}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.52121947152274, \"count\": 1, \"min\": 0.52121947152274, \"max\": 0.52121947152274}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2403479, \"EndTime\": 1622044701.2403617, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 24}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6701668534960066, \"count\": 1, \"min\": 0.6701668534960066, \"max\": 0.6701668534960066}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2404084, \"EndTime\": 1622044701.2404234, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 25}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6703189645494734, \"count\": 1, \"min\": 0.6703189645494734, \"max\": 0.6703189645494734}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2404604, \"EndTime\": 1622044701.2404747, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 26}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6703613213130406, \"count\": 1, \"min\": 0.6703613213130406, \"max\": 0.6703613213130406}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2405148, \"EndTime\": 1622044701.2405286, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 27}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6702348709106445, \"count\": 1, \"min\": 0.6702348709106445, \"max\": 0.6702348709106445}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2405806, \"EndTime\": 1622044701.2405963, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 28}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6768133231571742, \"count\": 1, \"min\": 0.6768133231571742, \"max\": 0.6768133231571742}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2406366, \"EndTime\": 1622044701.2406516, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 29}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6772297041756766, \"count\": 1, \"min\": 0.6772297041756766, \"max\": 0.6772297041756766}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2406943, \"EndTime\": 1622044701.2407086, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 30}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6768107073647636, \"count\": 1, \"min\": 0.6768107073647636, \"max\": 0.6768107073647636}}}\n",
      "\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044701.2407594, \"EndTime\": 1622044701.2407742, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"model\": 31}, \"Metrics\": {\"train_binary_classification_cross_entropy_objective\": {\"sum\": 0.6772993019648961, \"count\": 1, \"min\": 0.6772993019648961, \"max\": 0.6772993019648961}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy_objective <loss>=0.42155331884111674\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=binary_classification_cross_entropy_objective, value=0.23384656650679453\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] Epoch 14: Loss improved. Updating best model\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] Saving model for epoch: 14\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpnr6py1il/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #progress_metric: host=algo-1, completed 100.0 % of epochs\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044700.9886973, \"EndTime\": 1622044701.2494771, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\", \"epoch\": 14, \"Meta\": \"training_data_iter\"}, \"Metrics\": {\"Total Records Seen\": {\"sum\": 1130.0, \"count\": 1, \"min\": 1130, \"max\": 1130}, \"Total Batches Seen\": {\"sum\": 113.0, \"count\": 1, \"min\": 113, \"max\": 113}, \"Max Records Seen Between Resets\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Max Batches Seen Between Resets\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}, \"Reset Count\": {\"sum\": 17.0, \"count\": 1, \"min\": 17, \"max\": 17}, \"Number of Records Since Last Reset\": {\"sum\": 70.0, \"count\": 1, \"min\": 70, \"max\": 70}, \"Number of Batches Since Last Reset\": {\"sum\": 7.0, \"count\": 1, \"min\": 7, \"max\": 7}}}\n",
      "\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #throughput_metric: host=algo-1, train throughput=268.31255351834267 records/second\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 WARNING 140220882560832] wait_for_all_workers will not sync workers since the kv store is not running distributed\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 WARNING 140220882560832] wait_for_all_workers will not sync workers since the kv store is not running distributed\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #train_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.22941066793033055)\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #train_score (algo-1) : ('binary_classification_accuracy', 0.9285714285714286)\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #train_score (algo-1) : ('binary_f_1.000', 0.9397590361445783)\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #train_score (algo-1) : ('precision', 0.9512195121951219)\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #train_score (algo-1) : ('recall', 0.9285714285714286)\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #train_score (algo-1) : ('roc_auc_score', 0.9557823129251701)\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, train binary_classification_cross_entropy_objective <loss>=0.22941066793033055\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, train binary_classification_accuracy <score>=0.9285714285714286\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, train binary_f_1.000 <score>=0.9397590361445783\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, train precision <score>=0.9512195121951219\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, train recall <score>=0.9285714285714286\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] #quality_metric: host=algo-1, train roc_auc_score <score>=0.9557823129251701\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] Best model found for hyperparameters: {\"optimizer\": \"adam\", \"learning_rate\": 0.1, \"wd\": 0.0001, \"l1\": 0.0, \"lr_scheduler_step\": 100, \"lr_scheduler_factor\": 0.99, \"lr_scheduler_minimum_lr\": 0.0001}\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] Saved checkpoint to \"/tmp/tmpiaauph9p/mx-mod-0000.params\"\u001b[0m\n",
      "\u001b[34m[05/26/2021 15:58:21 INFO 140220882560832] Test data is not provided.\u001b[0m\n",
      "\u001b[34m#metrics {\"StartTime\": 1622044696.6236598, \"EndTime\": 1622044701.4461727, \"Dimensions\": {\"Algorithm\": \"Linear Learner\", \"Host\": \"algo-1\", \"Operation\": \"training\"}, \"Metrics\": {\"initialize.time\": {\"sum\": 194.29421424865723, \"count\": 1, \"min\": 194.29421424865723, \"max\": 194.29421424865723}, \"epochs\": {\"sum\": 15.0, \"count\": 1, \"min\": 15, \"max\": 15}, \"check_early_stopping.time\": {\"sum\": 12.678861618041992, \"count\": 15, \"min\": 0.1747608184814453, \"max\": 1.2860298156738281}, \"update.time\": {\"sum\": 4366.881608963013, \"count\": 15, \"min\": 254.19974327087402, \"max\": 386.8591785430908}, \"finalize.time\": {\"sum\": 190.60587882995605, \"count\": 1, \"min\": 190.60587882995605, \"max\": 190.60587882995605}, \"setuptime\": {\"sum\": 22.209882736206055, \"count\": 1, \"min\": 22.209882736206055, \"max\": 22.209882736206055}, \"totaltime\": {\"sum\": 5034.588575363159, \"count\": 1, \"min\": 5034.588575363159, \"max\": 5034.588575363159}}}\n",
      "\u001b[0m\n",
      "\n",
      "2021-05-26 15:58:45 Uploading - Uploading generated training model\n",
      "2021-05-26 15:59:11 Completed - Training job completed\n",
      "Training seconds: 97\n",
      "Billable seconds: 97\n",
      "CPU times: user 773 ms, sys: 69.7 ms, total: 843 ms\n",
      "Wall time: 5min 44s\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "\n",
    "# Train your estimator on S3 training data\n",
    "\n",
    "linear.fit({'train': s3_input_train})"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## EXERCISE: Deploy the trained model\n",
    "\n",
    "After training, deploy your model to create a `predictor`. If you're using a PyTorch model, you'll need to create a trained `PyTorchModel` that accepts the trained `<model>.model_data` as an input parameter and points to the provided `source_pytorch/predict.py` file as an entry point. \n",
    "\n",
    "To deploy a trained model, you'll use `<model>.deploy`, which takes in two arguments:\n",
    "* **initial_instance_count**: The number of deployed instances (1).\n",
    "* **instance_type**: The type of SageMaker instance for deployment.\n",
    "\n",
    "Note: If you run into an instance error, it may be because you chose the wrong training or deployment instance_type. It may help to refer to your previous exercise code to see which types of instances we used."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 9,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "---------------!CPU times: user 227 ms, sys: 17.7 ms, total: 245 ms\n",
      "Wall time: 7min 32s\n"
     ]
    }
   ],
   "source": [
    "%%time\n",
    "\n",
    "# uncomment, if needed\n",
    "# from sagemaker.pytorch import PyTorchModel\n",
    "\n",
    "\n",
    "# deploy your model to create a predictor\n",
    "predictor = linear.deploy(initial_instance_count=1, instance_type='ml.m4.xlarge')\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---\n",
    "# Evaluating Your Model\n",
    "\n",
    "Once your model is deployed, you can see how it performs when applied to our test data.\n",
    "\n",
    "The provided cell below, reads in the test data, assuming it is stored locally in `data_dir` and named `test.csv`. The labels and features are extracted from the `.csv` file."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 10,
   "metadata": {},
   "outputs": [],
   "source": [
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "import os\n",
    "\n",
    "# read in test data, assuming it is stored locally\n",
    "test_data = pd.read_csv(os.path.join(data_dir, \"test.csv\"), header=None, names=None)\n",
    "\n",
    "# labels are in the first column\n",
    "test_y = test_data.iloc[:,0]\n",
    "test_x = test_data.iloc[:,1:]"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "## EXERCISE: Determine the accuracy of your model\n",
    "\n",
    "Use your deployed `predictor` to generate predicted, class labels for the test data. Compare those to the *true* labels, `test_y`, and calculate the accuracy as a value between 0 and 1.0 that indicates the fraction of test data that your model classified correctly. You may use [sklearn.metrics](https://scikit-learn.org/stable/modules/classes.html#module-sklearn.metrics) for this calculation.\n",
    "\n",
    "**To pass this project, your model should get at least 90% test accuracy.**"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 17,
   "metadata": {},
   "outputs": [],
   "source": [
    "from sagemaker.predictor import csv_serializer, json_deserializer\n",
    "\n",
    "predictor.serializer = csv_serializer\n",
    "predictor.deserializer = json_deserializer"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 18,
   "metadata": {},
   "outputs": [
    {
     "name": "stderr",
     "output_type": "stream",
     "text": [
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The csv_serializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n",
      "The json_deserializer has been renamed in sagemaker>=2.\n",
      "See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.\n"
     ]
    },
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "Test passed!\n"
     ]
    }
   ],
   "source": [
    "# First: generate predicted, class labels\n",
    "test_x_np = test_x.values.astype('float32')\n",
    "test_y_preds = np.array([predictor.predict(test_x_np[i])['predictions'][0]['predicted_label'] for i in range(len(test_x_np))])\n",
    "\n",
    "\n",
    "\"\"\"\n",
    "DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n",
    "\"\"\"\n",
    "# test that your model generates the correct number of labels\n",
    "assert len(test_y_preds)==len(test_y), 'Unexpected number of predictions.'\n",
    "print('Test passed!')"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 20,
   "metadata": {},
   "outputs": [
    {
     "name": "stdout",
     "output_type": "stream",
     "text": [
      "1.0\n",
      "\n",
      "Predicted class labels: \n",
      "[1 1 1 1 1 1 0 0 0 0 0 0 1 1 1 1 1 1 0 1 0 1 1 0 0]\n",
      "\n",
      "True class labels: \n",
      "[1 1 1 1 1 1 0 0 0 0 0 0 1 1 1 1 1 1 0 1 0 1 1 0 0]\n"
     ]
    }
   ],
   "source": [
    "# Second: calculate the test accuracy\n",
    "test_labels = test_y.values\n",
    "test_preds = test_y_preds\n",
    "\n",
    "tp = np.logical_and(test_labels, test_preds).sum()\n",
    "fp = np.logical_and(1-test_labels, test_preds).sum()\n",
    "tn = np.logical_and(1-test_labels, 1-test_preds).sum()\n",
    "fn = np.logical_and(test_labels, 1-test_preds).sum()\n",
    "\n",
    "accuracy = (tp + tn) / (tp + fp + tn + fn)\n",
    "recall = tp / (tp + fn)\n",
    "precision = tp / (tp + fp)\n",
    "\n",
    "print(accuracy)\n",
    "\n",
    "\n",
    "## print out the array of predicted and true labels, if you want\n",
    "print('\\nPredicted class labels: ')\n",
    "print(test_y_preds)\n",
    "print('\\nTrue class labels: ')\n",
    "print(test_y.values)"
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 21,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/html": [
       "<div>\n",
       "<style scoped>\n",
       "    .dataframe tbody tr th:only-of-type {\n",
       "        vertical-align: middle;\n",
       "    }\n",
       "\n",
       "    .dataframe tbody tr th {\n",
       "        vertical-align: top;\n",
       "    }\n",
       "\n",
       "    .dataframe thead th {\n",
       "        text-align: right;\n",
       "    }\n",
       "</style>\n",
       "<table border=\"1\" class=\"dataframe\">\n",
       "  <thead>\n",
       "    <tr style=\"text-align: right;\">\n",
       "      <th>predictions</th>\n",
       "      <th>0</th>\n",
       "      <th>1</th>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>actuals</th>\n",
       "      <th></th>\n",
       "      <th></th>\n",
       "    </tr>\n",
       "  </thead>\n",
       "  <tbody>\n",
       "    <tr>\n",
       "      <th>0</th>\n",
       "      <td>10</td>\n",
       "      <td>0</td>\n",
       "    </tr>\n",
       "    <tr>\n",
       "      <th>1</th>\n",
       "      <td>0</td>\n",
       "      <td>15</td>\n",
       "    </tr>\n",
       "  </tbody>\n",
       "</table>\n",
       "</div>"
      ],
      "text/plain": [
       "predictions   0   1\n",
       "actuals            \n",
       "0            10   0\n",
       "1             0  15"
      ]
     },
     "execution_count": 21,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "pd.crosstab(test_labels, test_preds, rownames=['actuals'], colnames=['predictions'])"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Question 1: How many false positives and false negatives did your model produce, if any? And why do you think this is?"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** Answer**: \n",
    "The model classified all test cases correctly according to the confusion matrix above."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Question 2: How did you decide on the type of model to use? "
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "** Answer**: We should implement a baseline model first and then start from there with better algorithms. Sagemaker linear learner is used as the baseline here.\n",
    "\n"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "----\n",
    "## EXERCISE: Clean up Resources\n",
    "\n",
    "After you're done evaluating your model, **delete your model endpoint**. You can do this with a call to `.delete_endpoint()`. You need to show, in this notebook, that the endpoint was deleted. Any other resources, you may delete from the AWS console, and you will find more instructions on cleaning up all your resources, below."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 22,
   "metadata": {},
   "outputs": [],
   "source": [
    "# uncomment and fill in the line below!\n",
    "# <name_of_deployed_predictor>.delete_endpoint()\n",
    "predictor.delete_endpoint()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Deleting S3 bucket\n",
    "\n",
    "When you are *completely* done with training and testing models, you can also delete your entire S3 bucket. If you do this before you are done training your model, you'll have to recreate your S3 bucket and upload your training data again."
   ]
  },
  {
   "cell_type": "code",
   "execution_count": 23,
   "metadata": {},
   "outputs": [
    {
     "data": {
      "text/plain": [
       "[{'ResponseMetadata': {'RequestId': '7QVCWJ45SY4GTZAV',\n",
       "   'HostId': 'cGC7ooDG22zrbZemCtiQdm/t8UGoGkODcJ5jWJEK9VqaCFucoBzFGYazbxKw45Nba3LZU6pNtM4=',\n",
       "   'HTTPStatusCode': 200,\n",
       "   'HTTPHeaders': {'x-amz-id-2': 'cGC7ooDG22zrbZemCtiQdm/t8UGoGkODcJ5jWJEK9VqaCFucoBzFGYazbxKw45Nba3LZU6pNtM4=',\n",
       "    'x-amz-request-id': '7QVCWJ45SY4GTZAV',\n",
       "    'date': 'Wed, 26 May 2021 16:20:59 GMT',\n",
       "    'content-type': 'application/xml',\n",
       "    'transfer-encoding': 'chunked',\n",
       "    'server': 'AmazonS3',\n",
       "    'connection': 'close'},\n",
       "   'RetryAttempts': 0},\n",
       "  'Deleted': [{'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-report.ipynb'},\n",
       "   {'Key': 'sagemaker-pytorch-2021-05-25-14-07-37-350/debug-output/training_job_end.ts'},\n",
       "   {'Key': 'sagemaker-pytorch-2021-05-25-14-07-37-350/source/sourcedir.tar.gz'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-report.html'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/GPUMemoryIncrease.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/LowGPUUtilization.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/source/sourcedir.tar.gz'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/OverallFrameworkMetrics.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/profiler-output/system/incremental/2021052615/1622043480.algo-1.json'},\n",
       "   {'Key': 'sagemaker/sentiment_rnn/word_dict.pkl'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/IOBottleneck.json'},\n",
       "   {'Key': 'sagemaker-pytorch-2021-05-25-13-24-13-024/source/sourcedir.tar.gz'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/profiler-output/system/incremental/2021052615/1622044620.algo-1.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/OverallSystemUsage.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/LowGPUUtilization.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/Dataloader.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/IOBottleneck.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-45-46-626/profiler-output/system/incremental/2021052615/1622044140.algo-1.json'},\n",
       "   {'Key': 'sagemaker-pytorch-2021-05-25-14-07-37-350/output/model.tar.gz'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/profiler-output/system/training_job_end.ts'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/profiler-output/system/incremental/2021052615/1622043540.algo-1.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/profiler-output/system/incremental/2021052615/1622044680.algo-1.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-45-46-626/profiler-output/system/incremental/2021052615/1622044080.algo-1.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/StepOutlier.json'},\n",
       "   {'Key': 'sagemaker-pytorch-2021-05-26-01-05-19-885/sourcedir.tar.gz'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/BatchSize.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/BatchSize.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/MaxInitializationTime.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/Dataloader.json'},\n",
       "   {'Key': 'plagiarism-detection/train.csv'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-45-46-626/source/sourcedir.tar.gz'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/GPUMemoryIncrease.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/profiler-output/framework/training_job_end.ts'},\n",
       "   {'Key': 'sagemaker-pytorch-2021-05-25-13-25-57-466/source/sourcedir.tar.gz'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-report.ipynb'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/StepOutlier.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-report.html'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/OverallSystemUsage.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/MaxInitializationTime.json'},\n",
       "   {'Key': 'sagemaker/sentiment_rnn/train.csv'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/output/model.tar.gz'},\n",
       "   {'Key': 'plagiarism-detection/test.csv'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/LoadBalancing.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/LoadBalancing.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/OverallFrameworkMetrics.json'},\n",
       "   {'Key': 'plagiarism-detection/linear-learner-2021-05-26-15-53-46-851/rule-output/ProfilerReport-1622044426/profiler-output/profiler-reports/CPUBottleneck.json'},\n",
       "   {'Key': 'sagemaker-scikit-learn-2021-05-26-15-35-21-141/rule-output/ProfilerReport-1622043321/profiler-output/profiler-reports/CPUBottleneck.json'}]}]"
      ]
     },
     "execution_count": 23,
     "metadata": {},
     "output_type": "execute_result"
    }
   ],
   "source": [
    "# deleting bucket, uncomment lines below\n",
    "\n",
    "bucket_to_delete = boto3.resource('s3').Bucket(bucket)\n",
    "bucket_to_delete.objects.all().delete()"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Deleting all your models and instances\n",
    "\n",
    "When you are _completely_ done with this project and do **not** ever want to revisit this notebook, you can choose to delete all of your SageMaker notebook instances and models by following [these instructions](https://docs.aws.amazon.com/sagemaker/latest/dg/ex1-cleanup.html). Before you delete this notebook instance, I recommend at least downloading a copy and saving it, locally."
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "---\n",
    "## Further Directions\n",
    "\n",
    "There are many ways to improve or add on to this project to expand your learning or make this more of a unique project for you. A few ideas are listed below:\n",
    "* Train a classifier to predict the *category* (1-3) of plagiarism and not just plagiarized (1) or not (0).\n",
    "* Utilize a different and larger dataset to see if this model can be extended to other types of plagiarism.\n",
    "* Use language or character-level analysis to find different (and more) similarity features.\n",
    "* Write a complete pipeline function that accepts a source text and submitted text file, and classifies the submitted text as plagiarized or not.\n",
    "* Use API Gateway and a lambda function to deploy your model to a web application.\n",
    "\n",
    "These are all just options for extending your work. If you've completed all the exercises in this notebook, you've completed a real-world application, and can proceed to submit your project. Great job!"
   ]
  }
 ],
 "metadata": {
  "kernelspec": {
   "display_name": "conda_python3",
   "language": "python",
   "name": "conda_python3"
  },
  "language_info": {
   "codemirror_mode": {
    "name": "ipython",
    "version": 3
   },
   "file_extension": ".py",
   "mimetype": "text/x-python",
   "name": "python",
   "nbconvert_exporter": "python",
   "pygments_lexer": "ipython3",
   "version": "3.6.13"
  }
 },
 "nbformat": 4,
 "nbformat_minor": 4
}