qiita_fiware_camera

A demonstration to build a FIWARE platform that works with Azure Blob Storage to record images captured by IoT cameras.

Getting started

set your variable

1. copy variables/env.temp to variables/env, and edit variables to your own.

start Azure managed services

1. log in Azure

   $ ./installation/01_azure_login.sh

2. create resource group

   $ ./installation/02_azure_create_resourcegroup.sh

3. start Azure AKS

   $ ./installation/03_azure_start_aks.sh

   RESULT

   $ kubectl get nodes
   NAME                                STATUS   ROLES   AGE     VERSION
   aks-nodepool1-14606101-vmss000000   Ready    agent   7m12s   v1.24.0
   aks-nodepool1-14606101-vmss000001   Ready    agent   7m14s   v1.24.0
   aks-nodepool1-14606101-vmss000002   Ready    agent   7m17s   v1.24.0

4. start Azure Blob Storage

   $ ./installation/04_azure_blobstorage.sh

start MongoDB on Azure AKS

1. start MongoDB Pods

   $ ./installation/05_fiware_start_mongodb.sh

   RESULT

   $ kubectl get pods -l app.kubernetes.io/name=mongodb
   NAME        READY   STATUS    RESTARTS   AGE
   mongodb-0   1/1     Running   0          2m55s
   mongodb-1   1/1     Running   0          2m
   mongodb-2   1/1     Running   0          65s

2. construct MongoDB cluster

   $ ./installation/06_fiware_setup_mongodb.sh

   RESULT

   [
     {
       name: 'mongodb-0.mongodb-headless.default.svc.cluster.local:27017',
       stateStr: 'PRIMARY'
     },
     {
       name: 'mongodb-1.mongodb-headless.default.svc.cluster.local:27017',
       stateStr: 'SECONDARY'
     },
     {
       name: 'mongodb-2.mongodb-headless.default.svc.cluster.local:27017',
       stateStr: 'SECONDARY'
     }
   ]

start FIWARE components

1. after started MongoDB Cluster, start FIWARE Orion

   $ ./installation/07_fiware_start_orion.sh

   RESULT

   $ kubectl get pods -l app=orion
   NAME                     READY   STATUS    RESTARTS   AGE
   orion-54c98d69c7-4tjmh   1/1     Running   0          4m48s
   orion-54c98d69c7-964st   1/1     Running   0          4m48s
   orion-54c98d69c7-kgxrl   1/1     Running   0          4m48s

2. after started MongoDB Cluster and FIWARE Orion, start FIWARE Cygnus

   $ ./installation/08_fiware_start_cygnus.sh

   RESULT

   $ kubectl get pods -l app=cygnus
   NAME                      READY   STATUS    RESTARTS   AGE
   cygnus-6dc69bdd9f-l6kql   1/1     Running   0          105s
   cygnus-6dc69bdd9f-pzplw   1/1     Running   0          105s
   cygnus-6dc69bdd9f-w8dss   1/1     Running   0          105s

start API Gateway

1. after started FIWARE components, start kong

   $ ./installation/09_kong_start_kong.sh

   RESULT

   $ kubectl -n kong get pods
   NAME                            READY   STATUS    RESTARTS   AGE
   ingress-kong-6454f9b96b-nbfsp   2/2     Running   0          4m52s
   ingress-kong-6454f9b96b-xz6mh   2/2     Running   0          4m52s
   ingress-kong-6454f9b96b-zx9qw   2/2     Running   0          4m52s

   $ kubectl -n kong get services
   NAME                      TYPE           CLUSTER-IP     EXTERNAL-IP       PORT(S)                      AGE
   kong-proxy                LoadBalancer   10.0.104.182   xxx.xxx.xxx.xxx   80:31629/TCP,443:30182/TCP   3m31s
   kong-validation-webhook   ClusterIP      10.0.37.181    <none>            443/TCP   

2. register A Record to Azure DNS, and get TLS certification from Let's Encrypt

   $ ./installation/10_kong_start_cert-manager.sh

3. set the routing and security definitions

   $ ./installation/11_kong_setup_kong.sh

   RESULT

   $ curl -i http://fiware-camera.example.com/
   HTTP/1.1 404 Not Found
   Date: Sun, 26 Jun 2022 13:25:25 GMT
   Content-Type: application/json; charset=utf-8
   Connection: keep-alive
   Content-Length: 48
   X-Kong-Response-Latency: 0
   Server: kong/2.8.1
   
   {"message":"no Route matched with those values"}

   $ curl -i http://fiware-camera.example.com/version
   HTTP/1.1 301 Moved Permanently
   Date: Sun, 26 Jun 2022 13:26:10 GMT
   Content-Type: text/html
   Content-Length: 134
   Connection: keep-alive
   Location: https://fiware-camera.example.com/version
   X-Kong-Response-Latency: 0
   Server: kong/2.8.1
   
   <html>
   <head><title>301 Moved Permanently</title></head>
   <body>
   <center><h1>301 Moved Permanently</h1></center>
   </body>
   </html>

   $ curl -i https://fiware-camera.example.com/version
   HTTP/2 401
   date: Sun, 26 Jun 2022 13:26:37 GMT
   content-type: application/json; charset=utf-8
   www-authenticate: Key realm="kong"
   content-length: 45
   x-kong-response-latency: 0
   server: kong/2.8.1
   
   {
     "message":"No API key found in request"
   }

   $ curl -i -H "Authorization: ${API_TOKEN}" https://fiware-camera.example.com/version
   HTTP/2 200
   content-type: application/json
   content-length: 656
   fiware-correlator: f3fe3f82-f553-11ec-82c3-4a55b25ab823
   date: Sun, 26 Jun 2022 13:29:06 GMT
   x-kong-upstream-latency: 4
   x-kong-proxy-latency: 2
   via: kong/2.8.1
   
   {
   "orion" : {
     "version" : "3.4.0",
     "uptime" : "0 d, 0 h, 48 m, 20 s",
     "git_hash" : "e8ed9c5f363ab503ac406a9e62a213640d9c2864",
     "compile_time" : "Tue Dec 14 09:34:09 UTC 2021",
     "compiled_by" : "root",
     "compiled_in" : "5221bc0800ef",
     "release_date" : "Tue Dec 14 09:34:09 UTC 2021",
     "machine" : "x86_64",
     "doc" : "https://fiware-orion.rtfd.io/en/3.4.0/",
     "libversions": {
        "boost": "1_66",
        "libcurl": "libcurl/7.61.1 OpenSSL/1.1.1k zlib/1.2.11 nghttp2/1.33.0",
        "libmosquitto": "2.0.12",
        "libmicrohttpd": "0.9.70",
        "openssl": "1.1",
        "rapidjson": "1.1.0",
        "mongoc": "1.17.4",
        "bson": "1.17.4"
     }
   }
   }

set up FIWARE Entity and Subscription

1. register Entity

   $ ./setup/01_create_camera_entity.sh

2. register Subscription

   $ ./setup/02_subscribe_camera_entity.sh

set up IoT Camera

1. install python 3.10 and poetry

2. install libraries required to run OpenCV4

3. install rust so that cryptography can be built

4. copy camera_client directory to IoT Camera

5. copy env file to IoT Camera

6. obtain the connection string to connect to Azure Blob Storage

   $ ./variables/01_azure_storage_connectionstring.sh

7. log in to IoT Camera

8. install python libraries to IoT Camera

   $ poetry install

send images captured by the IoT Camera to Azure Blob Storage and FIWARE

1. activate the python virtual environment

   $ poetry shell

2. load environment variables from env file

   $ set -a;source ~/env; set +a

3. set connection string as an environment variable

   $ export AZURE_STORAGE_CONNECTION_STRING="...................<<your connection string>>...................."

4. start the capture command on IoT Camera

    ./main.py

License

MIT License

Copyright

Copyright (c) 2022 Nobuyuki Matsui