hydroflow_plus_cli_integration v0.5.1

Chore

• prep for initial release

  it contains the logic linking hydroflow+ to deploy, it should be published that’s a bug

• manually set lockstep-versioned crates (and lattices) to version 0.5.1
  Setting manually since
  frewsxcv/rust-crates-index#159 is messing with
  smart-release

Chore

• fix/add releasing for hydroflow_plus_cli_integration, stageleft[_macro/_tool]

New Features

• add APIs for declaring external ports on clusters
• improve API naming and polish docs
• pass subgraph ID through deploy metadata
• improve API naming and eliminate wire API for builders
• improve Rust API for defining services
• split Rust core from Python bindings

Commit Statistics

• 10 commits contributed to the release over the course of 44 calendar days.
• 9 commits were understood as conventional.
• 6 unique issues were worked on: #1013, #1056, #986, #987, #995, #996

Commit Details

view details

• #1013
  • Improve API naming and polish docs (6eeb9be)
• #1056
  • Prep for initial release (e9c7ced)
• #986
  • Split Rust core from Python bindings (c50ca12)
• #987
  • Improve Rust API for defining services (53d7aee)
• #995
  • Improve API naming and eliminate wire API for builders (b7aafd3)
• #996
  • Pass subgraph ID through deploy metadata (46d87fa)
• Uncategorized
  • Fix/add releasing for hydroflow_plus_cli_integration, stageleft[_macro/_tool] (03ce73d)
  • Release hydroflow_lang v0.5.2, hydroflow_datalog_core v0.5.2, hydroflow_macro v0.5.2, lattices v0.5.2, hydroflow v0.5.2, hydro_cli v0.5.1, hydroflow_plus_cli_integration v0.5.1 (6ac8720)
  • Manually set lockstep-versioned crates (and lattices) to version 0.5.1 (1b555e5)
  • Add APIs for declaring external ports on clusters (7d930a2)

lattices v0.5.2

New Features

• add map_union_with_tombstones, fix #336

Commit Statistics

• 1 commit contributed to the release.
• 4 days passed between releases.
• 1 commit was understood as conventional.
• 1 unique issue was worked on: #1052

Commit Details

view details

• #1052
  • Add map_union_with_tombstones, fix #336 (87e86a2)

hydroflow_macro v0.5.2

New Features

• implement state operator
  (#929)

Commit Statistics

• 1 commit contributed to the release over the course of 2 calendar days.
• 4 days passed between releases.
• 1 commit was understood as conventional.
• 1 unique issue was worked on: #1041

Commit Details

view details

• #1041
  • Implement state operator (7a791b8)

hydroflow_lang v0.5.2

Documentation

• source_iter_delta docs, fix #962

New Features

• implement state operator
  (#929)

• generate different idents for ref edges state
  (#929)

• Add input/output_edgtypes field to WriteContextArgs
  (#929)

• subgraph partitioning handling (ignoring) reference edges
  (#929)

  (currently panics)

• Add state, state_join ops for testing ref edges
  (#929)

Bug Fixes

• fix coloring of _lattice_join_fused_join, fix #943
• ensure other graph methods handle edge types
  (#929)

Commit Statistics

• 8 commits contributed to the release over the course of 2 calendar days.
• 4 days passed between releases.
• 8 commits were understood as conventional.
• 3 unique issues were worked on: #1041, #1053, #1055

Commit Details

view details

• #1041
  • Ensure other graph methods handle edge types (175cc20)
  • Implement state operator (7a791b8)
  • Generate different idents for ref edges state (420580d)
  • Add input/output_edgtypes field to WriteContextArgs (fa8cfdb)
  • Subgraph partitioning handling (ignoring) reference edges (5969bc9)
  • Add state, state_join ops for testing ref edges (f661f01)
• #1053
  • source_iter_delta docs, fix #962 (56fbc34)
• #1055
  • Fix coloring of _lattice_join_fused_join, fix #943 (a572dee)

hydroflow_datalog_core v0.5.2

Chore

• update snapshots for
  (#929)

Bug Fixes

• ensure other graph methods handle edge types
  (#929)

Commit Statistics

• 2 commits contributed to the release over the course of 2 calendar days.
• 4 days passed between releases.
• 2 commits were understood as conventional.
• 1 unique issue was worked on: #1041

Commit Details

view details

• #1041
  • Update snapshots for (d4d7862)
  • Ensure other graph methods handle edge types (175cc20)

hydroflow v0.5.2

Documentation

• add explanation for outputing synchronously from Hydroflow, fix #342

New Features

• add StateHandleErased (no type param) for storage in data structures, fix #1048

Bug Fixes

• fix coloring of _lattice_join_fused_join, fix #943
• ensure other graph methods handle edge types
  (#929)

Commit Statistics

• 4 commits contributed to the release over the course of 2 calendar days.
• 4 days passed between releases.
• 4 commits were understood as conventional.
• 4 unique issues were worked on: #1041, #1051, #1054, #1055

Commit Details

view details

• #1041
  • Ensure other graph methods handle edge types (175cc20)
• #1051
  • Add explanation for outputing synchronously from Hydroflow, fix #342 (fe2b4a7)
• #1054
  • Add StateHandleErased (no type param) for storage in data structures, fix #1048 (5cbce2b)
• #1055
  • Fix coloring of _lattice_join_fused_join, fix #943 (a572dee)

hydro_cli v0.5.1

Chore

• fix clippy lints on latest nightly

Bug Fixes

• don't vendor openssl and fix docker build

Chore

• manually set lockstep-versioned crates (and lattices) to version 0.5.1
  Setting manually since
  frewsxcv/rust-crates-index#159 is messing with
  smart-release
• generate pre-move changelogs for hydro_cli and hydroflow_cli_integration

New Features

• support building graphs for symmetric clusters in Hydroflow+
• auto-configure Hydro Deploy based on Hydroflow+ plans
• perf improvements and better deploy logic
• implement core fault tolerance protocol

• new implementation and Hydro Deploy setup

• improve Rust API for defining services
• split Rust core from Python bindings

Pre-Move Commit Statistics

• 6 commits contributed to the release over the course of 42 calendar days.
• 70 days passed between releases.
• 6 commits were understood as conventional.
• 6 unique issues were worked on: #909, #910, #914, #960, #982, #984

Pre-Move Commit Details

view details

• #909
  • New implementation and Hydro Deploy setup (6158a7a)
• #910
  • Implement core fault tolerance protocol (d8ca3d4)
• #914
  • Perf improvements and better deploy logic (7e46da0)
• #960
  • Fix clippy lints on latest nightly (ba6afab)
• #982
  • Auto-configure Hydro Deploy based on Hydroflow+ plans (9e27582)
• #984
  • Support building graphs for symmetric clusters in Hydroflow+ (174607d)

Commit Statistics

• 6 commits contributed to the release over the course of 43 calendar days.
• 114 days passed between releases.
• 5 commits were understood as conventional.
• 4 unique issues were worked on: #1046, #986, #987, #994

Commit Details

view details

• #1046
  • Generate pre-move changelogs for hydro_cli and hydroflow_cli_integration (69e0416)
• #986
  • Split Rust core from Python bindings (c50ca12)
• #987
  • Improve Rust API for defining services (53d7aee)
• #994
  • Don't vendor openssl and fix docker build (1ae27de)
• Uncategorized
  • Release hydroflow_cli_integration v0.5.1, hydroflow_lang v0.5.1, hydroflow_datalog_core v0.5.1, hydroflow_datalog v0.5.1, hydroflow_macro v0.5.1, lattices v0.5.1, variadics v0.0.3, pusherator v0.0.4, hydroflow v0.5.1, stageleft_macro v0.1.0, stageleft v0.1.0, hydroflow_plus v0.5.1, hydro_deploy v0.5.1, hydro_cli v0.5.1 (478aebc)
  • Manually set lockstep-versioned crates (and lattices) to version 0.5.1 (1b555e5)

variadics v0.0.3

Chore

• manually set lockstep-versioned crates (and lattices) to version 0.5.1
  Setting manually since
  frewsxcv/rust-crates-index#159 is messing with
  smart-release

Refactor

• Improvements prepping for release
  • Adds the "spread"/"splat" ... syntax to the three variadics macros.
  • Adds #[sealed] traits.
  • Adds testing of error messages.
  • Improves docs: README.md and Rust docs.

Commit Statistics

• 2 commits contributed to the release over the course of 37 calendar days.
• 253 days passed between releases.
• 2 commits were understood as conventional.
• 1 unique issue was worked on: #974

Commit Details

view details

• #974
  • Improvements prepping for release (7e65a08)
• Uncategorized
  • Manually set lockstep-versioned crates (and lattices) to version 0.5.1 (1b555e5)

stageleft_tool v0.1.0

Chore

• Commit empty CHANGELOG.md

New Features

• push down persists and implement Pi example
  Also fixes type inference issues with reduce the same way as we did for fold.

• split Rust core from Python bindings

• support crates that have no entrypoints
  Also includes various bugfixes needed for Hydroflow+.

• add initial test using Hydro CLI from Hydroflow+
  This also required a change to Hydroflow core to make it possible to run the dataflow itself on a single thread (using a LocalSet), even if the surrounding runtime is not single-threaded (required to work around deadlocks because we can't use async APIs inside Hydroflow+). This requires us to spawn any Hydroflow tasks (only for dest_sink at the moment) right next to when we run the dataflow rather than when the Hydroflow graph is initialized. From a conceptual perspective, this seems more right, since now creating a Hydroflow program will not result in any actual tasks running.

  In the third PR of this series, I aim to add a new Hydroflow+ operator that will automate the setup of a dest_sink/source_stream pair that span nodes.

• add a functional surface syntax using staging

Commit Statistics

• 6 commits contributed to the release over the course of 76 calendar days.
• 6 commits were understood as conventional.
• 5 unique issues were worked on: #1021, #899, #978, #983, #986

Commit Details

view details

• #1021
  • Push down persists and implement Pi example (af6e3be)
• #899
  • Add a functional surface syntax using staging (8b63568)
• #978
  • Add initial test using Hydro CLI from Hydroflow+ (e5bdd12)
• #983
  • Support crates that have no entrypoints (7108323)
• #986
  • Split Rust core from Python bindings (c50ca12)
• Uncategorized
  • Commit empty CHANGELOG.md (add8e60)

stageleft_macro v0.1.0

Documentation

• actually committing empty CHANGELOG.md is required

New Features

• push down persists and implement Pi example
  Also fixes type inference issues with reduce the same way as we did for fold.

• support crates that have no entrypoints
  Also includes various bugfixes needed for Hydroflow+.

• add initial test using Hydro CLI from Hydroflow+
  This also required a change to Hydroflow core to make it possible to run the dataflow itself on a single thread (using a LocalSet), even if the surrounding runtime is not single-threaded (required to work around deadlocks because we can't use async APIs inside Hydroflow+). This requires us to spawn any Hydroflow tasks (only for dest_sink at the moment) right next to when we run the dataflow rather than when the Hydroflow graph is initialized. From a conceptual perspective, this seems more right, since now creating a Hydroflow program will not result in any actual tasks running.

  In the third PR of this series, I aim to add a new Hydroflow+ operator that will automate the setup of a dest_sink/source_stream pair that span nodes.

• add a functional surface syntax using staging

Commit Statistics

• 5 commits contributed to the release over the course of 76 calendar days.
• 5 commits were understood as conventional.
• 4 unique issues were worked on: #1021, #899, #978, #983

Commit Details

view details

• #1021
  • Push down persists and implement Pi example (af6e3be)
• #899
  • Add a functional surface syntax using staging (8b63568)
• #978
  • Add initial test using Hydro CLI from Hydroflow+ (e5bdd12)
• #983
  • Support crates that have no entrypoints (7108323)
• Uncategorized
  • Actually committing empty CHANGELOG.md is required (3b36020)