Skip to content

Latest commit

 

History

History
133 lines (94 loc) · 6.77 KB

README.md

File metadata and controls

133 lines (94 loc) · 6.77 KB
Raw

SustainML


Download   •   Docs   •   News   •   Twitter   •   Contact Us



License Robotics Releases Issues Forks Stars Documentation Status



SustainML is a framework and an associated toolkit that will foster energy efficiency throughout the whole life-cycle of ML applications: from the design and exploration phase that includes exploratory iterations of training, testing and optimizing different system versions through the final training of the production systems (which often involves huge amounts of data, computation and epochs) and (where appropriate) continuous online re-training during deployment for the inference process. The framework will optimize the ML solutions based on the application tasks, across levels from hardware to model architecture. It will also collect both previously scattered efficiency-oriented research, as well as novel Green-AI methods.

AI developers from all experience levels can make use of the framework through its emphasis on human-centric interactive transparent design and functional knowledge cores, instead of the common blackbox and fully automated optimization approaches in AutoML.

Project status

This project is a work in progress and the following features presented here will be extended, updated, and improved in future versions.

Framework Architecture

The SustainML Framework is composed of different Software Modules, each one related to specific task, which are specialized in solving the different parts of the machine learning problem architecture definition, starting from the user’s problem description. Each of the modules conforms a Node. These steps are basically:

  1. Encode the problem and constraints defined by the user
  2. Suggest a machine learning model
  3. Propose an optimized hardware for running the suggested model
  4. Warn about the estimated carbon footprint that would take training the model in the hardware

All the Nodes shall import its corresponding Python library, so that each Node can be abstracted from the DDS communications.

Installation manual

The following sections describe the steps to install the SustainML Framework in Ubuntu.

  1. Installing the dependencies

    These packages provide the tools required to install SustainML and its dependencies from command line. Install them using the package manager of the appropriate Linux distribution. On Ubuntu use the command:

    apt install --yes --no-install-recommends \
    wget git cmake g++ build-essential python3 python3-pip libpython3-dev swig \
    libssl-dev libasio-dev libtinyxml2-dev libp11-dev libengine-pkcs11-openssl softhsm2 \
    qtdeclarative5-dev libqt5charts5-dev qtquickcontrols2-5-dev libqt5svg5 qml-module-qtquick-controls \
    qml-module-qtquick-controls2 && \
pip3 install -U \
    colcon-common-extensions vcstool

  2. Downloading sources

    Create a SustainML directory and download the repositories file that will be used to install SustainML Framework and its dependencies.

    mkdir -p ~/SustainML/src && cd ~/SustainML && \
wget https://raw.githubusercontent.com/eProsima/SustainML-Framework/main/sustainml.repos && \
vcs import src < sustainml.repos

  3. Building framework

    Colcon is a command line tool based on CMake aimed at building sets of software packages. With the following command, colcon builds and installs the SustainML framework, and sources the generated libraries and applications.

    colcon build && \
source ~/SustainML/install/setup.bash

  4. Deploy the framework

    The framework application to retrieve the user inputs is run with the sustainml command.

    sustainml

    The SustainML Framework needs each of the modules that are part of it for its deployment. The following list shows how do they should be run by using python.

    python3 ~/SustainML/src/sustainml_lib/sustainml_modules/sustainml_modules/sustainml-wp1/app_requirements_node.py
python3 ~/SustainML/src/sustainml_lib/sustainml_modules/sustainml_modules/sustainml-wp1/ml_model_metadata_node.py
python3 ~/SustainML/src/sustainml_lib/sustainml_modules/sustainml_modules/sustainml-wp1/ml_model_provider_node.py
python3 ~/SustainML/src/sustainml_lib/sustainml_modules/sustainml_modules/sustainml-wp2/hw_resources_provider_node.py
python3 ~/SustainML/src/sustainml_lib/sustainml_modules/sustainml_modules/sustainml-wp2/hw_constraints_node.py
python3 ~/SustainML/src/sustainml_lib/sustainml_modules/sustainml_modules/sustainml-wp3/carbon_footprint_node.py

Running SustainML Framework using Docker

The installation task can be omitted if using the Dockerimage proposed in this repository.

To deploy the SustainML Framework within docker, please refer to the docker instructions.

Getting Help

If you need support you can reach us by mail at [email protected] or by phone at +34 91 804 34 48.

This project has received funding from the European Union’s Horizon Europe research and innovation programme (HORIZON-CL4-2021-HUMAN-01) under grant agreement No 101070408.