CI Infrastructure

[stefanv]

Edit by bsipocz to hash out some ideas e.g. to include in CI templating, etc:

• job that tests nightly wheels/dev versions. Maybe a separate job that tests pre-releases.
• job that tests the oldest supported versions of declared dependencies
• cron jobs: notification are not working properly on github, we should implement a small tool, workaround to get notifications to maintainers
• filterwarnings to error out on warnings: expected warnings should be handled in CI, or ignored. Erroring out by default provides enormous help to notice new deprecations while upstream dependencies are still in their dev cycle (assuming there is a job that uses the dev versions/nightly builds)

Also, this could include documentation about the available CI tooling, though there is a risk involved here with keeping this up-to-date.

[drammock]

Related to #10 in that there are CI helpers / actions that could percolate up from the package level to the ecosystem level (and thereby benefit from wider adoption and thus a wider pool of contributors/maintainers).

Related to #9 in that there may be some documentation/tutorials that could live at the ecosystem level.

[drammock]

over in #20 @bsipocz mentioned something that might make sense here: encouragement / guidance / templates for member projects on setting up a CI job that uses pip --pre or nightlies or some other way of getting early warning of breaking changes in dependencies. This could involve tutorial/documentation material (#21) as well as template files (#10)

[bsipocz]

This could involve tutorial/documentation material (#21) as well as template files (#10)

I would have the templates as part of this issue, they have nothing to do with #10, at least I would not shovel the them there as we have a lot to do about the plugins et al without doing anything at all about the dev versions and CI configs.

[bsipocz]

(Needless to say that I would be very much interested in this one, too, but I used up my 3 assignments elsewhere 😉 )

[jarrodmillman]

• https://scientific-python.org/specs/spec-0004/
• https://scientific-python.org/specs/spec-0005/

[bsipocz]

another piece: cron github jobs to issue send out notifications (preferably staying within github rather than an email, but email is still better than the current not really predictable mess). Of course, it would be best if github would start supporting it, but I don't think we should wait for them as it could take years.

Chatted with Ross about this, but haven't come up with an actual implementation to make it happen.

[juanis2112]

Hackmd link for the summit: https://hackmd.io/0M1Yh7KwTnaXSsU14BiyQw