New test user upload process

[ghost]

We want to create a new process which will enable our test user to directly upload their data to their blob storage and the Database.

We need to create a way for our trusted user to upload their data through our process. I leave this part of the issue to the backend/frontend team to figure how to connect us with the users.

Sequence of the uploading process

sequenceDiagram;
  actor User
  box grey Ai-Lab services
  participant Frontend
  participant Backend
  participant Datastore
  end
  box grey Storage services
  participant PostgreSQL Database
  participant Azure Storage
  end

    User ->> Frontend: Upload session request
    Frontend -->> User: Show session form
    User -) Frontend: Fill form :<br> Seed selection, nb Seeds/Pic, Zoom
    User -) Frontend: Upload: session folder
    Frontend ->> Backend: Upload from trusted user request: <br> Seed info, nbSeeds/Pic, Zoom ,<br> Session Folder & User
    Backend -) Datastore: upload_picture_set (cursor, pictures, user_id, seed_name, zoom_level, nb_seeds)
    Datastore --> PostgreSQL Database: is_seed_registered(seed_name)
    Datastore --> PostgreSQL Database: is_a_user_id(user_id)
    Datastore -) PostgreSQL Database: get_container_url()
    Datastore ->> Datastore: build_picture_set()
    Datastore -) PostgreSQL Database: new_picture_set(user_id)
    Datastore -) Azure Storage: create_folder(picture_set_id)
    loop for each picture_encoded in pictures
      Datastore -) PostgreSQL Database: new_picture(seed_id,picture_set_id)
      Datastore -) Azure Storage: upload_image(picture_encoded)
      Datastore ->> Datastore: build_picture(picture_encoded,blob_url)
      Datastore -) PostgreSQL: update_picture_metadata(picture_id,picture)
    end

Loading

Inputs needed:

• userEmail
• seed info (this needs to be validated)
• number of seeds (integer)
• zoom level (float)
• folder (with the pictures)

Backend:

• Change implementation of API endpoints to use nachet-datastore for storing images and images related metadata nachet-backend#69

Frontend:

• User Feature Request: Implement Data Upload Feature for Test Users nachet-frontend#127

DataBase :

• Creating structure for Nachet DB packages ailab-datastore#11
• Create process to upload metadata for trusted users ailab-datastore#13
• Linking test users to their containers in DB using Bytebase #93
• Adding Nachet DB packages to Ai-Lab repo #94
• Uploading metadata to DB

[MaxenceGui]

I think we should consider this issue as an epic since it could lead to tasks being done in the backend and the database (as well as eventually the frontend?)