Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Standardising Benchmarks, with support for nanobench as an option for its backend #6448

Open
wants to merge 24 commits into
base: master
Choose a base branch
from
Open

Standardising Benchmarks, with support for nanobench as an option for its backend #6448

wants to merge 24 commits into from
+449 −151

Commits on Jul 10, 2024

  1. Add initial nanobench benchmark config 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    5167e12 View commit details
    Browse the repository at this point in the history

  2. Pyperf integration for testing puporses 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    16e42ea View commit details
    Browse the repository at this point in the history

  3. Added interface for nanbench backend, and tested interface with minma… 

    …x perf test

Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    3d38818 View commit details
    Browse the repository at this point in the history

  4. Added workflows to test out benchmarks 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    35a3f1d View commit details
    Browse the repository at this point in the history

  5. Modified CI to build and test minmax benchmark only 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    59363bd View commit details
    Browse the repository at this point in the history

  6. Added separate CI for benchmark without nanobench 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    506e240 View commit details
    Browse the repository at this point in the history

  7. Changing new CI name 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    cbee8b1 View commit details
    Browse the repository at this point in the history

  8. Correcting CI names 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    2979001 View commit details
    Browse the repository at this point in the history

  9. Changing CI activations to PR only 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    4683bea View commit details
    Browse the repository at this point in the history

  10. Adding back namespace defs and add_library call for nanobench 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    1f2ae1c View commit details
    Browse the repository at this point in the history

  11. Clean up minmax test 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    ee41a79 View commit details
    Browse the repository at this point in the history

  12. Adding command line argument for detailed bench output 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    4bb7d3d View commit details
    Browse the repository at this point in the history

  13. Fixing CI format 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    77fa197 View commit details
    Browse the repository at this point in the history

  14. Adding initial benchmark visualisation script 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    2e6258a View commit details
    Browse the repository at this point in the history

  15. Added benchmark output specialisations for normal case as well 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    794de41 View commit details
    Browse the repository at this point in the history

  16. Standardised modules.datastructures.small_vector_benchmark, and made … 

    …minor changes to plotting script

* Further simplified the default template for the benchmark

Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    af5726b View commit details
    Browse the repository at this point in the history

  17. Updated cmdline switching to local config, and refactored benchmarks … 

    …accordingly

Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    14374ed View commit details
    Browse the repository at this point in the history

  18. Removing definition of inline variable, and modified CIs to use the c… 

    …orrect option

Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    21fc400 View commit details
    Browse the repository at this point in the history

  19. Applying cmake-format and clang-format 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    1d18a5c View commit details
    Browse the repository at this point in the history

  20. Adding explicit double to long double conversions for the default case 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    995ae0e View commit details
    Browse the repository at this point in the history

  21. Fixed implicit conversion issue while using add_time function 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    cc25fb1 View commit details
    Browse the repository at this point in the history

  22. Standardised foreach_report, stream_report and future_overhead_report… 

    …, and made minor changes to perftests ci

Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    33ea494 View commit details
    Browse the repository at this point in the history

  23. Fixing clang-format for performance.cpp and future_overhead_report 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 10, 2024
    Configuration menu
    Copy the full SHA
    526e048 View commit details
    Browse the repository at this point in the history

Commits on Jul 14, 2024

  1. Removed perftests_plot.py, and made minor clean-up changes 

    Signed-off-by: Vedant <[email protected]>
    @vrnimje
    vrnimje committed Jul 14, 2024
    Configuration menu
    Copy the full SHA
    c35e4e4 View commit details
    Browse the repository at this point in the history