Release/4.0.4 (#114)

* Prepare changelog for 4.0.4.

* Prepare changelog for 4.0.4.

* Prepare changelog for 4.0.4.

* Prepare changelog for 4.0.4.

* Add pr #115.

* Add pr #115.

* Add pr #85.

CHANGELOG.md

@@ -1,35 +1,59 @@
 # Changelog
 
-All notable changes to flatland will be documented in this file.
+All notable changes to Flatland will be documented in this file.
 
 The format is based on [Keep a Changelog](https://keepachangelog.com/),
 and this project adheres to [Semantic Versioning](https://semver.org/).
 
-## [Unreleased]
-
+## [[4.0.4](https://github.com/flatland-association/flatland-rl/milestone/1)]
+
+### Added
+
+* Grid to DiGraph Conversion and Graph Simplification [pr [#90](https://github.com/flatland-association/flatland-rl/pull/90)]
+  and [pr [flatland-book#6](https://github.com/flatland-association/flatland-book/pull/6)]
+* Policy evaluation and training cli (rllib) [pr [#85](https://github.com/flatland-association/flatland-rl/pull/85)]
+    - extract ml dependencies (torch, gym, ray, etc.) to optional dependencies in `pyproject.toml`, new `requirements-ml.txt` and slimmer
+      `requirements[-dev].txt`, keep core `gym` free.
+    - accordingly, move corresponding code to new `flatland.ml` module
+    - accordingly, move corresponding tests to `tests.ml` (tests becomes a Python module)
+* Enable redis in ci and run `test_service.ipynb` in ci [pr [#65](https://github.com/flatland-association/flatland-rl/pull/65)]
+* Run main workflow daily and allow for manual triggering. Update deprecated gh actions versions,
+  see [GitHub Blog](https://github.blog/changelog/2024-03-07-github-actions-all-actions-will-run-on-node20-instead-of-node16-by-default/) [pr [#83](https://github.com/flatland-association/flatland-rl/pull/83)].
+* Add `AWS_ENDPOINT_URL` env var to override default S3 endpoint URL in
+  `aicrowd_helpers.py` [pr [#112](https://github.com/flatland-association/flatland-rl/pull/112)].
+* Add episodes for benchmarking and regression tests [pr [#105](https://github.com/flatland-association/flatland-rl/pull/105)].
+* Dump `results.json` (evaluation state) along `results.csv` [pr [#115](https://github.com/flatland-association/flatland-rl/pull/115)].
+* Dump evaluation state along results output path. Make test env folder and supported client versions configurable for evaluation
+  service. [pr [#115](https://github.com/flatland-association/flatland-rl/pull/115)].
+* Policy evaluation and training cli (rllib) [pr [#85](https://github.com/flatland-association/flatland-rl/pull/85)].
 
 ### Fixed
 
-* non-deterministic test failures [pr [#103](https://github.com/flatland-association/flatland-rl/pull/103)]
-
-## [4.0.3] - 2024-04-23
-
-### New
-
-* grid to digraph conversion. [pr [#90](https://github.com/flatland-association/flatland-rl/pull/90)]
-* data structures for decision point graph. [pr [#90](https://github.com/flatland-association/flatland-rl/pull/90)]
-
-### Removed
-
-* Remove images folder. [pr [#82](https://github.com/flatland-association/flatland-rl/pull/82)]
-* Remove rendering folder. [pr [#81](https://github.com/flatland-association/flatland-rl/pull/81)]
-* Cleanup scripts folder. [pr [#80](https://github.com/flatland-association/flatland-rl/pull/80)]
-* Remove action_plan module as obsolete. [pr [#79](https://github.com/flatland-association/flatland-rl/pull/79)]
+* Add flatland-rl [apidocs](https://flatland-association.github.io/flatland-book/apidocs/index.html) back to flatland book
+  again [pr [flatland-book#7](https://github.com/flatland-association/flatland-book/pull/7)]
+* Fix flapping test malfunctions [pr [#103](https://github.com/flatland-association/flatland-rl/pull/103)]
+* Fix `README.md` indefinite article before a vowel sound [pr [#95](https://github.com/flatland-association/flatland-rl/pull/95)]
 
 ### Changed
 
+* Bump jinja2 from 3.1.4 to 3.1.5 [pr [#106](https://github.com/flatland-association/flatland-rl/pull/106)]
 * Bump tornado from 6.4.1 to 6.4.2. [pr [#93](https://github.com/flatland-association/flatland-rl/pull/93)]
 * Bump aiohttp from 3.10.10 to 3.10.11. [pr [#94](https://github.com/flatland-association/flatland-rl/pull/94)]
+* Deployment [flatland-book](https://github.com/flatland-association/flatland-book) to GitHub
+  Pages [pr [flaland-book#4](https://github.com/flatland-association/flatland-book/pull/4)]
+  and [pr [flatland-book#5](https://github.com/flatland-association/flatland-book/pull/5)]
+  and [pr [#98](https://github.com/flatland-association/flatland-rl/pull/98)]
+
+### Removed
+
+* Use Python >= 3.10 (drop support for deprecated python 3.8 eol 2024-10-07, see https://devguide.python.org/versions/). Move ml dependencies from core
+  dependencies to optional ml dependencies [pr [#84](https://github.com/flatland-association/flatland-rl/pull/84)].
+* Remove images folder. Images not referenced in documentation any more. Remove skipped test (fails tested
+  locally) [pr [#82](https://github.com/flatland-association/flatland-rl/pull/82)].
+* Rendering folder is not used. Descriptions in txt file are also contained in
+  `examples/misc/generate_video/video_generation.md` [pr [#81](https://github.com/flatland-association/flatland-rl/pull/81)].
+* Cleanup scripts folder to contain only scripts to be run with `make` [pr [#80](https://github.com/flatland-association/flatland-rl/pull/80)].
+* Remove `flatland.action_plan` module as obsolete [pr [#79](https://github.com/flatland-association/flatland-rl/pull/79)]
 
 ## [4.0.3] - 2024-04-23