Create a benchmarks module #166

lppedd · 2024-01-30T12:59:27Z

Closes: #165

You can run JVM benchmarks with:

gradlew :antlr-kotlin-benchmarks:jvmBenchmark

And you can run JS benchmarks by removing the @Ignore annotation from ManualMySQLBenchmarks, with:

gradlew :antlr-kotlin-benchmarks:jsTests

You can observe that the first warm up run is extremely slow in JS:

Warm up 1: 8575.3754 ms
Warm up 2: 742.1048 ms
Warm up 3: 603.8989 ms
...

Tho even on the JVM the first run is pretty slow.

Warm up 1: 2618.4108 ms
Warm up 2: 217.177499 ms
Warm up 3: 158.166601 ms
...

Backported and adapted from ANTLR5.

Use too much time, and will be replaced by kotlinx-benchmarks at some point.

ftomassetti · 2024-02-01T07:24:02Z

Thank you, this is very valuable. Could you add a description of this in the README?

lppedd · 2024-02-01T12:43:22Z

Could you add a description of this in the README?

ftomassetti · 2024-02-01T13:02:35Z

Looks good to me. Thank you @lppedd and @mike-lischke for the discussion and providing the inspiration for this

lppedd added 5 commits January 30, 2024 11:55

build: allow setting the JS test timeout in each module

580781c

build: declare the dependency repositories at the settings level

be3993d

chore: fix template nullabilities to allow the MySQL grammar to compile

6c7f653

refactor: fix StringCharStream.getText

cf18397

Backported and adapted from ANTLR5.

feat: create a benchmarks module

851a223

lppedd force-pushed the feat/benchmarks branch from 91905d7 to 851a223 Compare January 30, 2024 13:09

lppedd added 2 commits January 30, 2024 15:24

refactor: simplify ManualMySQLBenchmarks

b01fc2b

refactor: ignore benchmark tests by default

5b0215b

Use too much time, and will be replaced by kotlinx-benchmarks at some point.

lppedd mentioned this pull request Jan 31, 2024

Fix code generation by partially backporting ANTLR5 changes #167

Merged

lppedd added 2 commits January 31, 2024 23:18

refactor: allow benchmarks on wasmJs

335c592

refactor: drop the slowest run

5961d4b

lppedd force-pushed the feat/benchmarks branch 2 times, most recently from e900998 to 2ad7206 Compare February 1, 2024 12:32

docs: add a section to explain benchmarks

1790d78

lppedd force-pushed the feat/benchmarks branch from 2ad7206 to 1790d78 Compare February 1, 2024 12:38

ftomassetti merged commit 4928049 into Strumenta:master Feb 1, 2024
6 checks passed

lppedd deleted the feat/benchmarks branch February 1, 2024 13:08

Provide feedback