This architecture uses Oracle Data Integrator or Data Integration Service to load and optimize data from multiple into an object storage bucket. Oracle Streams is used for ingesting continuous, high-volume streams of data into object storage. Data Science is used to build, train, and manage machine learning (ML) models in Oracle Cloud Infrastructure. Data Flow is used to run your Apache Spark applications.
The Oracle Data Integrator Component of this architecture needs to be launched using the Oracle Data Integrator marketplace image (https://cloudmarketplace.oracle.com/marketplace/en_US/listing/62627436)
The OCI Terraform Provider is now available for automatic download through the Terraform Provider Registry. For more information on how to get started view the documentation and setup guide.
Now, you'll want a local copy of this repo. You can make that with the commands:
git clone https://github.com/oracle-quickstart/oci-arch-adw-oac
cd oci-arch-adw-oac/adw-odi-data-science
ls
First off, you'll need to do some pre-deploy setup. That's all detailed here. Also ensure that you have followed the steps in the documentation [here] (https://docs.cloud.oracle.com/iaas/data-integration/using/preparing-for-connectivity.htm) to ensure that you are able to launch a Data Integration workspace.
Secondly, create a terraform.tfvars file and populate with the following information:
# Authentication
tenancy_ocid = "<tenancy_ocid>"
user_ocid = "<user_ocid>"
fingerprint = "<finger_print>"
private_key_path = "<pem_private_key_path>"
# SSH Keys
ssh_public_key = "<public_ssh_key_path>"
# Region
region = "<oci_region>"
# Compartment
compartment_ocid = "<compartment_ocid>"
# Object Storage
bucket_namespace = "<enter_tenancy_name_here>"
Deploy:
terraform init
terraform plan
terraform apply
When you no longer need the deployment, you can run this command to destroy it:
terraform destroy
