Skip to content

Conversation

@eregon
Copy link
Member

@eregon eregon commented Oct 19, 2025

  • Without needing a copy of the benchmark files.

eightbitraptor and others added 16 commits October 15, 2025 19:36
Co-Authored-By: Luke Gruber <[email protected]>
Co-Authored-By: Étienne Barrié <[email protected]>
Committed seperately so the noisy diff can be easily excluded from
reviews if needed.
These can be run as follows:

ruby -Iharness-ractor/harness.rb benchmarks-ractor/json_parse_float/benchmark.rb

Co-Authored-By: Luke Gruber <[email protected]>
If your ruby's bundler is different from the saved result in
`Gemfile.lock`, bundler autoswitches by starting a new process. When it
does this it sometimes doesn't pick up the old LOAD_PATH and results in
a LoadError.

Switch to use `Bundler.setup`, which is a simpler process and uses the
current bundler.
2 implementations, one using Process.fork, and one using Ractors - for
comparison
This is a copy of the Optcarrot benchmark from benchmarks/optcarrot, but
modified to be compatible with multiple Ractors
Instead -Iharness-name can be used
This commit introduces a harness that can be used to chain two (or more)
harnesses together.

For example. To run a Ractor test with Vernier you can wrap the ractor
harness with the vernier one as follows

HARNESS_CHAIN="vernier,ractor" ruby -Iharness-chain benchmarks-ractor/optcarrot/benchmark.rb
This commit modifies the benchmark runner to add 2 new categories:

--category=ractor-only Runs only those benchmarks in benchmarks-ractor
using the Ractor harness.

--category=ractor In addition to the ractor-only benchmarks, this will
run benchmarks specified in benchmarks.yml with `ractor: true` using the
Ractor harness.

In addition to this we've modified the burn in and run once scripts to
use the new harnesses and categories too

Co-Authored-By: Luke Gruber <[email protected]>
Also make sure that the benchmarks list test is up to date
…ness

* Without needing a copy of the benchmark files.
@eightbitraptor eightbitraptor force-pushed the ractor-harness-luke branch 3 times, most recently from a278094 to e191c14 Compare October 27, 2025 21:26
@eregon
Copy link
Member Author

eregon commented Oct 28, 2025

Integrated in #375 (comment)

@eregon eregon closed this Oct 28, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants