Adds network energy balance plots

[p-glaum]

Closes # (if applicable).

Changes proposed in this Pull Request

This PR is still a draft and needs improvement. Only uses statistics functions to create network plots by including scripts from @bobbyxng, @FabianHofmann and me.

Feel free to make improvements/changes to make it even more modular.

Checklist

• I tested my contribution locally and it works as intended.
• Code and workflow changes are sufficiently documented.
• Changed dependencies are added to envs/environment.yaml.
• Changes in configuration options are added in config/config.default.yaml.
• Changes in configuration options are documented in doc/configtables/*.csv.
• Sources of newly added data are documented in doc/data_sources.rst.
• A release note doc/release_notes.rst is added.

TODOS

• Add all plotting config settings to the plotting.yaml
• improve scaling parameters
• automatically take all carriers from balance_map for plotting of maps
• write collecting rule to plot all maps
• try to calculate flow width from branch width. not sure if this is possible and how exactly flow and branch_width are related. But would be nice to only have branch_factor

[FabianHofmann]

this looks nice @p-glaum, what is the status? can I support with something?

[p-glaum]

this looks nice @p-glaum, what is the status? can I support with something?

status hasn't changed so far 😅 . It was just an initial draft that the code is not lost/forgotten. I think it still needs some cleaning and updating because not all graphs look nice at the moment. I collected some TODOs above.
Currently, I don't have the time to continue on this. @bobbyxng was also working on this, but I think he is currently also busy. So if you want, you can go ahead with the implementation :)

[github-actions]

Validator Report

I am the Validator. Download all artifacts here.
I'll be back and edit this comment for each new commit.

General

Plots comparison

Main branch	Feature branch

Files comparison

	Status	NRMSE	MAE (norm)
market_values.csv	⚠️Changed	0.000	0.12
weighted_prices.csv	⚠️Changed	0.652	0.59
metrics.csv	⚠️Changed	0.004	0.15
price_statistics.csv	⚠️Changed	0.000	0.17
nodal_supply_energy.csv	⚠️ NaN mismatch
prices.csv	⚠️ NaN mismatch
nodal_cfs.csv	⚠️ NaN mismatch
supply.csv	⚠️ NaN mismatch
nodal_costs.csv	⚠️ NaN mismatch
nodal_capacities.csv	⚠️ NaN mismatch
capacities.csv	⚠️ NaN mismatch
curtailment.csv	⚠️ NaN mismatch
costs.csv	⚠️ NaN mismatch
cfs.csv	⚠️ NaN mismatch
supply_energy.csv	⚠️ NaN mismatch
energy.csv	⚠️ NaN mismatch

NRMSE: Normalized (combined-min-max) Root Mean Square Error
MAE (norm): Mean Absolute Error on normalized data (min-max)
Status Threshold: MAE (norm) > 0.05 and NRMSE > 0.3

Model Metrics

Benchmarks

Comparing add_modular_map_plots (5294621) with master (52b8179).
Branch is 8 commits ahead and 4 commits behind.
Last updated on 2024-11-05 15:02:53 CET.

[p-glaum]

I fixed some bugs and made it compatible with the newest master version. For me, it is working and almost all plots look nice. Maybe we can fine tune the config a bit further. This PR is currently not interfering with default snakemake workflow, as you need to call the plot function separately with plot_balance_maps.

[fneum]

I will have a quick pass over this once @bobbyxng has given his feedback he announced bilaterally.

Don't forget to reference the rules in the documentation and add a release note :)

[bobbyxng]

In my tests, the plots of all carriers ran through @fneum, so the implementation generally looks good to me, only two smaller remarks:

• All plotting-related configs will be moved from config.default.yaml to plotting.default.yaml, as @p-glaum suggested. I support the idea.
• vmin, vmax, see comment here: Adds network energy balance plots #1285 (comment)

[p-glaum]

I will have a quick pass over this once @bobbyxng has given his feedback he announced bilaterally.

Don't forget to reference the rules in the documentation and add a release note :)

added release note and documentation. There are just two minor open TODOs but you can already take look if you want.