Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Non-integer amount of resources #626

Merged
merged 11 commits into from
Oct 17, 2023
Merged

Non-integer amount of resources #626

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
11 commits
Select commit Hold shift + click to select a range
ba6cb54
First version of fractional resources
spirali May 18, 2023
4bcfad9
Fractional resources ported to HQ
spirali Sep 26, 2023
1d4cccc
PyAPI updated to ResourceAmount
spirali Oct 1, 2023
625bbcf
Migrated benchmarks to ResourceAmount
spirali Oct 1, 2023
e3ef14c
Float allowed in def file resources
spirali Oct 2, 2023
a53ff24
Python resource request accept float values
spirali Oct 2, 2023
da438fa
Fixed allocation order invariant
spirali Oct 2, 2023
bc6fa82
Clippy fixed
spirali Oct 2, 2023
8ad0c2d
Docs for non-integer amounts
spirali Oct 2, 2023
9b57468
Resource "mem" changes documented
spirali Oct 3, 2023
db59440
Code review responses for non-integer resources requests
spirali Oct 7, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
13 changes: 13 additions & 0 deletions CHANGELOG.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,19 @@
# Dev

## Breaking change

### Memory resource in megabytes

* Automatically detected resource "mem" that is the size of RAM of a worker is now using megabytes as a unit.
i.e. `--resource mem=100` asks now for 100 MiB (previously 100 bytes).

## New features

### Non-integer resource requests
* You may now ask of non-integer amount of a resource. e.g. for 0.5 of GPU.
This enables resource sharing on the logical level of HyperQueue scheduler and allows to utilize remaining part the resource
by another tasks.

### Job submission
* You can now specify `cleanup modes` when passing `stdout`/`stderr` paths to tasks. Cleanup mode decides what should
happen with the file once the task has finished executing. Currently, a single cleanup mode is implemented, which removes
Expand All @@ -10,6 +22,7 @@ the file if the task has finished successfully:
$ hq submit --stdout=out.txt:rm-if-finished /my-program
```


# v0.16.0

## New features
Expand Down
Loading