Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[SD-126] Save model summary during benchmarking #53

Merged
merged 30 commits into from
Jan 24, 2025
Merged

Conversation

OCarrollM
Copy link
Collaborator

No description provided.

Copy link
Contributor

dagshub bot commented Jan 20, 2025

@OCarrollM OCarrollM marked this pull request as draft January 20, 2025 16:48
@OCarrollM OCarrollM requested review from osw282 and d-lowl January 21, 2025 13:04
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Top level comment: I'd split this file into a script under power_logging and the utility functions left here.
Just so that it can be properly called from the top level package (and the instructions for it included in the README)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On top of that. We should have a bash script that would run the said script for all the models and save the results to raw_data/prebuilt_models/{model_name}/model_summary.json

@OCarrollM OCarrollM requested a review from d-lowl January 21, 2025 14:32
@OCarrollM OCarrollM marked this pull request as ready for review January 21, 2025 14:33
Copy link
Member

@d-lowl d-lowl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice solution for getting the needed parameters. See comments below for the refactoring suggestions.

jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

On top of that. We should have a bash script that would run the said script for all the models and save the results to raw_data/prebuilt_models/{model_name}/model_summary.json

jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
… file, added parse arguments to save_model_summary
@OCarrollM OCarrollM requested a review from d-lowl January 21, 2025 16:31
…pyproject and created bash script for model summaries
@OCarrollM OCarrollM requested review from d-lowl and osw282 January 22, 2025 12:06
Copy link
Member

@d-lowl d-lowl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good overall! Two more thing:

  • A comment regarding input shape
  • Could you run the script and add the results to DVC? Something like dvc add raw_data/prebuilt_models && git add raw_data/prebuilt_models.dvc && dvc push -r origin should do (ensure that you have the latest DVC data by pulling first, though)

jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
jetson/power_logging/model/save_model_summary.py Outdated Show resolved Hide resolved
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

uv needs locking dependencies again, after removing torchsummary from the dependencies list

Copy link
Member

@dudeperf3ct dudeperf3ct left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Added few suggestions but not necessary to hold this PR.

There seems to be a merge conflict with DVC tracked file.

jetson/power_logging/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/generate_model_summaries.sh Outdated Show resolved Hide resolved
jetson/power_logging/generate_model_summaries.sh Outdated Show resolved Hide resolved
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Test for this as a separate ticket would be great.

@d-lowl d-lowl merged commit 0e74515 into develop Jan 24, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants