-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
v0.4.0-alpha.1: Port to async & add bigml-parallel tool
This version of the Rust `bigml` client now uses nightly Rust (and tokio 1.x) to provide async APIs. This breaks BigML source upload abilities because BigML doesn't yet support `Transfer-Encoding: chunked` without `Content-Length:`. This release also includes a new `bigml-parallel` CLI tool that can be used to execute a WhizzML script in parallel over multiple sources or datasets, outputting the BigML execution JSON returned by each run. The degree of parallelism is controllable, and the input resource IDs can be streamed on standard input.
- Loading branch information
Showing
3 changed files
with
19 additions
and
2 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,6 +1,6 @@ | ||
[package] | ||
name = "bigml-parallel" | ||
version = "0.1.0" | ||
version = "0.4.0-alpha.1" | ||
authors = ["Eric Kidd <[email protected]>"] | ||
edition = "2018" | ||
|
||
|
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,17 @@ | ||
# A unofficial, incomplete `bigml` client for Rust | ||
|
||
[![Documentation](https://img.shields.io/badge/documentation-docs.rs-yellow.svg)](https://docs.rs/bigml/) | ||
|
||
An interface to the [BigML][] machine learning API, written in Rust. We use this at Faraday, so it's pretty reliable for what it does. But it omits many features that we don't need to access from Rust. In particular, we focus first on supporting WhizzML scripts, and many other parts of the API are much less complete. | ||
|
||
What works: | ||
|
||
- Fetching information about many different kinds of resources. | ||
- Creating a few kinds of resources. | ||
- Updating selected properties of a few kinds of resources. | ||
- Uploading sources that are small enough to fit in memory. | ||
- Executing scripts and getting the output values. | ||
|
||
It's pretty easy to add new types and fields. See `src/resources` for existing examples. We will happily accept PRs adding new resource types! | ||
|
||
[BigML]: https://bigml.com/ |