Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SD-154] Create a PyTorch energy estimation CLI tool #73

Open
wants to merge 16 commits into
base: develop
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Binary file added ecoml/.DS_Store
Binary file not shown.
182 changes: 182 additions & 0 deletions ecoml/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,182 @@
# Byte-compiled / optimized / DLL files
__pycache__/
*.py[cod]
*$py.class

# C extensions
*.so

# Distribution / packaging
.Python
build/
develop-eggs/
dist/
downloads/
eggs/
.eggs/
lib/
lib64/
parts/
sdist/
var/
wheels/
share/python-wheels/
*.egg-info/
.installed.cfg
*.egg
MANIFEST

# PyInstaller
# Usually these files are written by a python script from a template
# before PyInstaller builds the exe, so as to inject date/other infos into it.
*.manifest
*.spec

# Installer logs
pip-log.txt
pip-delete-this-directory.txt

# Unit test / coverage reports
htmlcov/
.tox/
.nox/
.coverage
.coverage.*
.cache
nosetests.xml
coverage.xml
*.cover
*.py,cover
.hypothesis/
.pytest_cache/
cover/

# Translations
*.mo
*.pot

# Django stuff:
*.log
local_settings.py
db.sqlite3
db.sqlite3-journal

# Flask stuff:
instance/
.webassets-cache

# Scrapy stuff:
.scrapy

# Sphinx documentation
docs/_build/

# PyBuilder
.pybuilder/
target/

# Jupyter Notebook
.ipynb_checkpoints

# IPython
profile_default/
ipython_config.py

# pyenv
# For a library or package, you might want to ignore these files since the code is
# intended to run in multiple environments; otherwise, check them in:
# .python-version

# pipenv
# According to pypa/pipenv#598, it is recommended to include Pipfile.lock in version control.
# However, in case of collaboration, if having platform-specific dependencies or dependencies
# having no cross-platform support, pipenv may install dependencies that don't work, or not
# install all needed dependencies.
#Pipfile.lock

# UV
# Similar to Pipfile.lock, it is generally recommended to include uv.lock in version control.
# This is especially recommended for binary packages to ensure reproducibility, and is more
# commonly ignored for libraries.
#uv.lock

# poetry
# Similar to Pipfile.lock, it is generally recommended to include poetry.lock in version control.
# This is especially recommended for binary packages to ensure reproducibility, and is more
# commonly ignored for libraries.
# https://python-poetry.org/docs/basic-usage/#commit-your-poetrylock-file-to-version-control
#poetry.lock

# pdm
# Similar to Pipfile.lock, it is generally recommended to include pdm.lock in version control.
#pdm.lock
# pdm stores project-wide configurations in .pdm.toml, but it is recommended to not include it
# in version control.
# https://pdm.fming.dev/latest/usage/project/#working-with-version-control
.pdm.toml
.pdm-python
.pdm-build/

# PEP 582; used by e.g. github.com/David-OConnor/pyflow and github.com/pdm-project/pdm
__pypackages__/

# Celery stuff
celerybeat-schedule
celerybeat.pid

# SageMath parsed files
*.sage.py

# Environments
.env
.venv
env/
venv/
ENV/
env.bak/
venv.bak/

# Spyder project settings
.spyderproject
.spyproject

# Rope project settings
.ropeproject

# mkdocs documentation
/site

# mypy
.mypy_cache/
.dmypy.json
dmypy.json

# Pyre type checker
.pyre/

# pytype static type analyzer
.pytype/

# Cython debug symbols
cython_debug/

# PyCharm
# JetBrains specific template is maintained in a separate JetBrains.gitignore that can
# be found at https://github.com/github/gitignore/blob/main/Global/JetBrains.gitignore
# and can be added to the global gitignore or merged into this file. For a more nuclear
# option (not recommended) you can uncomment the following to ignore the entire idea folder.
#.idea/

# Ruff stuff:
.ruff_cache/

# PyPI configuration file
.pypirc

ecoml_models

# PyTorch models
*.pth
*.pt

mlruns
1 change: 1 addition & 0 deletions ecoml/.python-version
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
3.12.3
56 changes: 56 additions & 0 deletions ecoml/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,56 @@
# EcoML

## Table of Contents

- [Introduction](#introduction)
- [Installation](#installation)
- [Usage](#usage)

## Introduction

EcoML aims to provide accurate power consumption estimates for edge devices, helping developers optimize their applications for energy efficiency.

## Installation

To install the necessary dependencies, run the following command:

```bash
uv venv
source .venv/bin/activate
uv sync
```

> [!NOTE]
> Coming Soon: We will also publish the package on PyPI for ease of use.

## Usage

To use EcoML for energy estimation of PyTorch models, follow these steps:

1. Using PyTorch model summary

```bash
ecoml predict --model sample_data/resnet18.json
```

[Sample data](./sample_data/) folder contains model summary for 3 PyTorch models - Resnet18, Mobilenetv2 and VGG16.

To use a custom model for inference, you have to generate a model summary for the PyTorch model. Refer to the next section for how to use `ecoml` in your workflow.

`--verbose` flag can be passed to above command to get a detailed output.

2. Using custom PyTorch model in your workflow

```bash
from ecoml.model_summary.model_summary import get_summary

summary = get_summary(your_pt_model, model_input_shape, summary_file_path='summary/my_model.json')
```

Here `your_pt_model` is a instance `nn.Module`, the trained PyTorch model.

Next, you can use the `predict` command to get the energy prediction using the path where model summary is saved.

```bash
ecoml predict --model summary/my_model.json
```
46 changes: 46 additions & 0 deletions ecoml/pyproject.toml
Original file line number Diff line number Diff line change
@@ -0,0 +1,46 @@
[project]
name = "ecoml"
version = "0.1.0"
description = "Predict energy consumption of PyTorch CNN models on Jetson Orin"
readme = "README.md"
authors = [
{ name = "fuzzylabs", email = "[email protected]" }
]
requires-python = ">=3.11"
dependencies = [
"dagshub>=0.5.5",
"mlflow==2.18.0",
"pandas>=2.2.3",
"pydantic>=2.10.6",
"rich>=13.9.4",
"typer>=0.15.1",
"cloudpickle==3.1.0",
"psutil==6.1.0",
"scikit-learn==1.5.2",
"scipy==1.14.1",
"numpy==2.1.2",
"tqdm>=4.67.1",
]

[[tool.uv.index]]
name = "pytorch-cpu"
url = "https://download.pytorch.org/whl/cpu"
explicit = true


[tool.uv.sources]
torch = [
{ index = "pytorch-cpu", extra = "torch"},
]

[project.scripts]
ecoml = "ecoml.ecoml:app"

[project.optional-dependencies]
torch = [
"torch>=2.6.0",
]

[build-system]
requires = ["hatchling"]
build-backend = "hatchling.build"
Loading