Skip to content

CI: Avoid GH throttling via Consolidation #565

Open
@texastony

Description

@texastony

Issue:

Our CI can fail due to GitHub throwing a 429.
i.e: Too many CI actions tried to pull from the repo and GitHub throttled us.

There are two causes of this:

  1. We use GH Workflow Matrices, which spawn a job per entry
  2. Every Dependabot PR updates on a merge

Thus the requests to pull the Repo from GitHub is:

|dependabot_prs| x 79

Where 79 is the current number of individual GitHub actions created through our matrix use.

A Solution:

Too prevent this in the future, we should consolidate are GitHub Workflow Jobs.

Technically, a Job could run all the tox envs for a OS Version,
even across Python versions.

That would dramatically reduce the requests to pull the repo down.

This reduce the number GitHub Jobs and increase the Steps per Job.

We would loose some of our high level test reporting,
but I believe that is acceptable.

Originally posted by @texastony in #564 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions