pachyderm_demo_commands.txt

1.0 Git Clone Brain MRI Code
git clone  https://github.com/boon1987/brain_mri.git ./brain_mri_demo 
git clone  https://github.com/boon1987/brain_mri.git ./brain_mri_demo 

2.0 Cd to code 
cd brain_mri

3.0 Create OpenCV edge detection pipeline
sudo nano pds_version/edge_detection_pipeline/edge_detection_v2.yml
pachctl create pipeline -f ./pds_version/edge_detection_pipeline/edge_detection_v2.yml

4.0 Create Brain MRI PDK Pipeline
pachctl create pipeline -f ./pds_version/training_deployment_pipelines/deployment-pipeline.yml
pachctl update pipeline -f ./pds_version/training_deployment_pipelines/deployment-pipeline.yml
pachctl delete pipeline -f ./pds_version/training_deployment_pipelines/deployment-pipeline.yml

5.0 Put file to the repo
pachctl put file -r Input_Training_Dataset@branch_v1:kaggle_3m_dataset/incremental_data4 -f ../brain_mri_dataset/TCGA_CS_4941_19960909
pachctl get file  Input_Training_Dataset@branch_v1:kaggle_3m_dataset/data.csv > a.csv

Other 1:
pachctl list repo 
pachctl list branch Input_Training_Dataset
pachctl list files Input_Training_Dataset@branch_v1

Other 2: Install pachyderm
pip install python_pachyderm
curl -o ./pachctl.deb -L https://github.com/pachyderm/pachyderm/releases/download/v2.7.2/pachctl_2.7.2_amd64.deb && dpkg -i ./pachctl.deb

Other 3: Login
Connect to Pach: pachctl connect grpc://10.90.1.52 
Login: pachctl auth login 
List Project: pachctl list project 
Set active context: pachctl config update context --project Brain-MRI 
Get active context: pachctl config get active-context 
Create repo: pachctl create repo raw_data 
Put files: pachctl put files -r raw_data@branch1:valid -f ./CheXpert-v1.0-small/valid -p 12 –progress 
Get file: pachctl get file  mri_raw_data@branch_v1:kaggle_3m_dataset/data.csv > a.csv 
Tar files: tar -cf kaggle_3m_dataset.tar kaggle_3m_dataset 
Put tar file: pachctl put file raw_data@branch_v1:kaggle_3m_dataset --untar -r -f valid.tar