ECMWF realtime data are not available from Microsoft's Azure: "https://ai4edataeuwest.blob.core.windows.net/ecmwf"

[Cong-Lee]

see below for access notes：
Microsoft Azure has recently changed the anonymous access function to ECMWF open data. Users can still access the data anonymously but they must request a short-lived SAS token.

please update your herbie, thanks!

[blaylockbk]

Can you provide more details about this change? I haven't heard about it. I'm not sure what a SAS token is.

[blaylockbk]

Found this

https://confluence.ecmwf.int/plugins/servlet/mobile?contentId=272310539#content/view/272310539

Which points to this...
https://planetarycomputer.microsoft.com/docs/concepts/sas/

Not sure yet how to implement this in Herbie right now. Sounds like we will need to depend on the planetary-computer python package. This is annoying.

Anyone out there have suggestions?

[blaylockbk]

Actually, maybe we just need to make a call to the token endpoint to the file we are trying to download.

Maybe if azure is in Herbie source priority list, get a token even if we don't need it. Or, only get a token when a file is requested from azure. Not sure what to do yet.

[blaylockbk]

I looks to me that this policy change is only affecting ECMWF forecasts right now. Let me know if anyone sees any others.

[blaylockbk]

Created a pull request with a quick and hacky fix. Needs some testing to find any issues and edge cases.