Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add memory profiling for catalog #4264

Open
noklam opened this issue Oct 28, 2024 · 0 comments
Open

Add memory profiling for catalog #4264

noklam opened this issue Oct 28, 2024 · 0 comments
Milestone
Improve performan...

Comments

@noklam
Copy link
Contributor

noklam commented Oct 28, 2024 •
edited
Loading

Context

In the current setup, we use the same pipeline and catalog configuration and we try to test memory usage by running nodes with heavy compute load that should not grow the memory. So it feels like we might add other scenarios that grow it and we're able to compare (memory grows as expected) runs on them.

Originally posted by @ElenaKhaustova in #4210 (comment)

Description

Add memory profiling for catalogs.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
Kedro Framework
Status: No status
Milestone
Improve performance of Kedro
Development

No branches or pull requests
2 participants
@noklam @merelcht