Clarify Data Science Tutorials

A space for data science tutorials using Clarify.

Note that some tutorials use an outdated version of PyClarify SDK

Table of Contents

1. Introduction (PyClarify 0.4.0)
2. Forecasting (PyClarify 0.3.5)
3. Pattern Recognition (PyClarify 0.3.5)
4. Google Cloud Hosting (PyClarify 0.3.5)
5. Pipelines and Deployment with Orchest and Clarify (PyClarify 0.3.5)
6. Email notifications of anomaly data points with Clarify using Orchest! (PyClarify 0.3.5)

Introduction

In the introduction notebook, you will get familiarised with the basics of interfacing with Clarify using python.

Topics covered:

• Connecting to Clarify using the PyClarify SDK
• Reading data from Clarify
• Creating Signals and Items
• Sending data back to Clarify
• Publishing Signals and creating Timelines

Forecasting

In the Forecasting tutorial, you will learn how to use data from Clarify for forecasting. We will present the steps to read and prepare the data, use a forecasting method (via the merlion library) and write the results back in Clarify.

Topics covered:

• Reading data and meta-data from Clarify
• Apply a forecasting method
• Write the forecast in Clarify
• Visualize the forecast in Clarify

Pattern Recognition

In the pattern recognition notebook, you will gain a deeper understanding of how to bring Clarify and data science together. We will show you how to apply a pattern recognition algorithm to your data and create items with your results. After that, you will be able to share your knowledge and discoveries with other members of your organization.

Topics covered:

• Read Item data from Clarify
• Apply a Pattern Recognition Algorithm
• Create Patterns
• Write signals to Clarify
• Visualize and share your results in Clarify

Google Cloud Hosting

In the Google Cloud hosting notebook you will be introduced to a way for writing data to Clarify continuously using an external API of your choice.

Topics covered:

• Choose an API from where you will get your data
• Integrating with Clarify
• Create a docker image
• Google Cloud Hosting
• See results in Clarify

Pipelines and Deployment with Orchest and Clarify

In this notebook, you will learn how to combine Clarify for data exploration, visualization and collaboration with Orchest for data pipelines development and deployment.

Topics covered:

• Quickstart importing the example project and pipeline
• Pipelines in Orchest
• Read, write and forecast nodes
• Configuring recurring tasks
• Visualizing the results in Clarify

Anomaly detection with email notifications in Clarify - using Orchest!

In this notebook you will learn how to do anomaly detection of your data in Clarify and get email notifications whenever an anomaly occurs, using Orchest pipelines.

Topics covered:

• Import a Project from GitHub and Inspect the pipeline
• Do anomaly detection
• Create a job
• View results in Clarify and receive email notifications