Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Release v2.3.0+0.1.9+8.19 #44

Merged
merged 190 commits into from
Oct 16, 2024
Merged

Release v2.3.0+0.1.9+8.19 #44

merged 190 commits into from
Oct 16, 2024

Conversation

K-dizzled
Copy link
Collaborator

No description provided.

@GlebSolovev
Expose one of hidden GenerationsLogger tests
5d7dc8b
@GlebSolovev
Design draft benchmarking results
799de6b
@GlebSolovev
Design and implement single benchmark
6b8daea
@GlebSolovev
Design draft benchmarks setup
c9802e5
@GlebSolovev
Introduce BenchmarkingItem, refactor
448552b
@GlebSolovev
Design benchmarking result
2b05da0
@GlebSolovev
Handle errors, build result in single benchmark
547755b
@GlebSolovev
Design benchmarks logging
0c5e3fa
@GlebSolovev
Log single benchmark
1e4bb26
@GlebSolovev
Implement and use asOneRecord logs
b01d577
@GlebSolovev
Implement executeBenchmarkingTask
8efd10e
@GlebSolovev
Remove unused AppendLogsBuilder
93709d7
@GlebSolovev
Implement top-level benchmark function
2c1d0e8
@GlebSolovev
Design & implement targets builders
dcf15c0
@GlebSolovev
Design & implement benchmarking bundles
679ca2c
@GlebSolovev
Implement Experiment basics
b6a9749
@GlebSolovev
Introduce TargetType, improve merge targets
40783f6
@GlebSolovev
Implement draft benchmarking items build
ac6ae57
@GlebSolovev
Study IPC, design draft processes interaction
0d35cd1
@GlebSolovev
Fix BenchmarkingLogger implementation
fb06b93
@GlebSolovev
Improve ajv errors wrappers
3aacf95
@GlebSolovev
Design & implement child process execution API
56ea671
@GlebSolovev
Implement execution as child process
fec266a
@GlebSolovev
Refactor subprocess utils file structure
20e0644
@GlebSolovev
Implement SubprocessesScheduler
b85df54
@GlebSolovev
Improve subprocess utils structure
37454ea
@GlebSolovev
Implement test wrapper for subprocess executables
0602f79
@GlebSolovev
Implement checkGeneratedProofsInSubprocess
32ee044
@GlebSolovev
Design and resolve experiment run options
92f8f1d
@GlebSolovev
Call subprocess proofs validation in benchmarks
482fc2e
GlebSolovev and others added 28 commits October 7, 2024 11:47
@GlebSolovev
Support TeamCity benchmark setup
97f375a
@GlebSolovev
Generate TeamCity example input
3a43156
@GlebSolovev
Remove rudimentary single-task runner
52b259a
@GlebSolovev
Separate legacy benchmark
61218d5
@GlebSolovev
Update benchmarkSingleCompletionGeneration docs
e508f36
@K-dizzled @GlebSolovev
Sketch report holder class for benchmark
c872a71
@K-dizzled @GlebSolovev
Finish POV for the automatic report generation
d4735d4
@K-dizzled @GlebSolovev
Allow additional imports in benchmarks + generalize report
9f4746f
@K-dizzled @GlebSolovev
Fix bug with Additional imports
e72432c
@K-dizzled @GlebSolovev
Fix markdown report representation generation
132a242
@K-dizzled @GlebSolovev
Get rid of the projectRooot constant in benchmark
29b76a6
@khram2003 @GlebSolovev
Fixed premise selection with different metrics
52156f6
@K-dizzled @GlebSolovev
Fix bug with dublication of the output channel
f744799 
Built-in output channel in vscode was used for logging events of the
CoqLSP used inside. Output channels were created for each CoqLSP
instance. Now it's fixed.
@GlebSolovev
Fix last rebase & format code
af0a679
@GlebSolovev
Update supported openai models
5c75a6a
@GlebSolovev
Fix code style: naming & repetitions
76920be
@GlebSolovev
Update tests with new openai models
937f059
@GlebSolovev
Create benchmarking framework guide
e11e740
@GlebSolovev
Fix table of contents in benchmarking guide
9c9b428
@GlebSolovev
Fix typos & links in benchmarking guide
c3324ac
@GlebSolovev
Update imm submodule
2fede9f
@GlebSolovev
Merge branch 'v2.3.0-dev' into benchmarking-rework
7618911
@GlebSolovev
Optimize parsing of prove-theorem targets
0f4605e
@GlebSolovev
Merge pull request #43 from JetBrains-Research/benchmarking-rework
6c1e16f 
New benchmarking framework, first release 🌟
@K-dizzled
Update CHANGELOG for release v2.3.0
e7359f0
@K-dizzled
Update default coq-lsp version from 0.1.8 to 0.1.9
ec4bc2c
@K-dizzled
Update setup OCaml action version to prevent dep issue
4366bf4
@K-dizzled
Fix test timeouts for MacOS CI passing
e88b14e
@K-dizzled K-dizzled merged commit 7e728cf into main Oct 16, 2024
3 checks passed
@K-dizzled K-dizzled deleted the v2.3.0-dev branch October 16, 2024 17:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@K-dizzled @GlebSolovev @khram2003