Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Permanent Throttle Option #170

Merged
merged 7 commits into from
Sep 24, 2024

infitite TTL logic in throttler

821c40a
Select commit
Loading
Failed to load commit list.
Merged

Add Permanent Throttle Option #170

infitite TTL logic in throttler
821c40a
Select commit
Loading
Failed to load commit list.
GitHub CI / freno-build-deploy-tarball succeeded Sep 24, 2024 in 1m 3s

Build 100995152

Build #100995152 succeeded in 63s

Details

Preparing Build...
Cloning repository https://github.com/github/freno.git
Cloned from SHA: 821c40ac75705ef01af5a54dd926e15dee555468
Logging into Docker (octofactory.service.private-us-east-1.github.net)...
WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /workspace/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded
Logging into Docker (octofactory.githubapp.com)...
WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /workspace/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded
Logging into Docker (https://registry-1.docker.io/)...
WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /workspace/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded
Logging into Docker (docker.pkg.github.com)...
WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /workspace/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded
Logging into Docker (containers.pkg.github.com)...
WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /workspace/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded
Logging into Docker (ghcr.io)...
WARNING! Using --password via the CLI is insecure. Use --password-stdin. WARNING! Your password will be stored unencrypted in /workspace/.docker/config.json. Configure a credential helper to remove this warning. See https://docs.docker.com/engine/reference/commandline/login/#credentials-store Login Succeeded
Detecting Golden Images...
Retrieving Golden Images...
Error response from daemon: manifest for octofactory.service.private-us-east-1.github.net/github-golden-docker/github-freno:app not found: manifest unknown: The named manifest is not known to the registry. Failed to pull golden image octofactory.service.private-us-east-1.github.net/github-golden-docker/github-freno:app
Done pulling golden images.
Bootstrapping container...
Building app Sending build context to Docker daemon 15.57MB Step 1/12 : FROM golang:1.16-stretch 1.16-stretch: Pulling from library/golang ec52bb9d0b76: Pulling fs layer f289049e62eb: Pulling fs layer 1e926c3d7cca: Pulling fs layer fd63791ebe32: Pulling fs layer cc1809a7c00d: Pulling fs layer 6c9846e33388: Pulling fs layer 2eef0bd377c1: Pulling fs layer 6c9846e33388: Waiting cc1809a7c00d: Waiting 2eef0bd377c1: Waiting fd63791ebe32: Waiting 1e926c3d7cca: Verifying Checksum 1e926c3d7cca: Download complete f289049e62eb: Verifying Checksum f289049e62eb: Download complete fd63791ebe32: Verifying Checksum fd63791ebe32: Download complete cc1809a7c00d: Verifying Checksum cc1809a7c00d: Download complete ec52bb9d0b76: Verifying Checksum ec52bb9d0b76: Download complete 2eef0bd377c1: Verifying Checksum 2eef0bd377c1: Download complete ec52bb9d0b76: Pull complete f289049e62eb: Pull complete 1e926c3d7cca: Pull complete fd63791ebe32: Pull complete cc1809a7c00d: Pull complete 6c9846e33388: Verifying Checksum 6c9846e33388: Download complete 6c9846e33388: Pull complete 2eef0bd377c1: Pull complete Digest: sha256:13d8ba0c6d1556e568e091fcfdbfab12e74eba8229e19982d421360861c5c720 Status: Downloaded newer image for golang:1.16-stretch ---> c6f80a9088b5 Step 2/12 : LABEL maintainer="[email protected]" ---> Running in 545953867fb6 Removing intermediate container 545953867fb6 ---> a2de7cfc30dd Step 3/12 : RUN sed -i -e 's/deb.debian.org/archive.debian.org/g' -e 's|security.debian.org|archive.debian.org/|g' -e '/stretch-updates/d' /etc/apt/sources.list ---> Running in ff3ae735919c Removing intermediate container ff3ae735919c ---> 6381f869a75b Step 4/12 : RUN useradd -m testuser ---> Running in da1fe99e9189 Removing intermediate container da1fe99e9189 ---> b0e757a02a85 Step 5/12 : RUN apt-get update ---> Running in 7f4f94abf1a8 Ign:1 http://archive.debian.org/debian stretch InRelease Get:2 http://archive.debian.org//debian-security stretch/updates InRelease [59.1 kB] Get:3 http://archive.debian.org/debian stretch Release [118 kB] Get:4 http://archive.debian.org/debian stretch Release.gpg [3177 B] Get:5 http://archive.debian.org//debian-security stretch/updates/main amd64 Packages [782 kB] Get:6 http://archive.debian.org/debian stretch/main amd64 Packages [7080 kB] Fetched 8042 kB in 1s (5130 kB/s) Reading package lists... Removing intermediate container 7f4f94abf1a8 ---> e4f4774dd13b Step 6/12 : RUN apt-get install -y lsb-release ---> Running in d889af6f0374 Reading package lists... Building dependency tree... Reading state information... The following additional packages will be installed: dh-python distro-info-data libmpdec2 libpython3-stdlib libpython3.5-minimal libpython3.5-stdlib python3 python3-minimal python3.5 python3.5-minimal Suggested packages: lsb python3-doc python3-tk python3-venv python3.5-venv python3.5-doc binfmt-support The following NEW packages will be installed: dh-python distro-info-data libmpdec2 libpython3-stdlib libpython3.5-minimal libpython3.5-stdlib lsb-release python3 python3-minimal python3.5 python3.5-minimal 0 upgraded, 11 newly installed, 0 to remove and 19 not upgraded. Need to get 4945 kB of archives. After this operation, 24.9 MB of additional disk space will be used. Get:1 http://archive.debian.org//debian-security stretch/updates/main amd64 libpython3.5-minimal amd64 3.5.3-1+deb9u5 [574 kB] Get:2 http://archive.debian.org//debian-security stretch/updates/main amd64 python3.5-minimal amd64 3.5.3-1+deb9u5 [1692 kB] Get:3 http://archive.debian.org/debian stretch/main amd64 python3-minimal amd64 3.5.3-1 [35.3 kB] Get:4 http://archive.debian.org/debian stretch/main amd64 libmpdec2 amd64 2.4.2-1 [85.2 kB] Get:5 http://archive.debian.org//debian-security stretch/updates/main amd64 libpython3.5-stdlib amd64 3.5.3-1+deb9u5 [2167 kB] Get:6 http://archive.debian.org//debian-security stretch/updates/main amd64 python3.5 amd64 3.5.3-1+deb9u5 [231 kB] Get:7 http://archive.debian.org/debian stretch/main amd64 libpython3-stdlib amd64 3.5.3-1 [18.6 kB] Get:8 http://archive.debian.org/debian stretch/main amd64 dh-python all 2.20170125 [86.8 kB] Get:9 http://archive.debian.org/debian stretch/main amd64 python3 amd64 3.5.3-1 [21.6 kB] Get:10 http://archive.debian.org/debian stretch/main amd64 distro-info-data all 0.36 [5810 B] Get:11 http://archive.debian.org/debian stretch/main amd64 lsb-release all 9.20161125 [27.1 kB] [91mdebconf: delaying package configuration, since apt-utils is not installed [0mFetched 4945 kB in 0s (21.5 MB/s) Selecting previously unselected package libpython3.5-minimal:amd64. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 15106 files and directories currently installed.) Preparing to unpack .../0-libpython3.5-minimal_3.5.3-1+deb9u5_amd64.deb ... Unpacking libpython3.5-minimal:amd64 (3.5.3-1+deb9u5) ... Selecting previously unselected package python3.5-minimal. Preparing to unpack .../1-python3.5-minimal_3.5.3-1+deb9u5_amd64.deb ... Unpacking python3.5-minimal (3.5.3-1+deb9u5) ... Selecting previously unselected package python3-minimal. Preparing to unpack .../2-python3-minimal_3.5.3-1_amd64.deb ... Unpacking python3-minimal (3.5.3-1) ... Selecting previously unselected package libmpdec2:amd64. Preparing to unpack .../3-libmpdec2_2.4.2-1_amd64.deb ... Unpacking libmpdec2:amd64 (2.4.2-1) ... Selecting previously unselected package libpython3.5-stdlib:amd64. Preparing to unpack .../4-libpython3.5-stdlib_3.5.3-1+deb9u5_amd64.deb ... Unpacking libpython3.5-stdlib:amd64 (3.5.3-1+deb9u5) ... Selecting previously unselected package python3.5. Preparing to unpack .../5-python3.5_3.5.3-1+deb9u5_amd64.deb ... Unpacking python3.5 (3.5.3-1+deb9u5) ... Selecting previously unselected package libpython3-stdlib:amd64. Preparing to unpack .../6-libpython3-stdlib_3.5.3-1_amd64.deb ... Unpacking libpython3-stdlib:amd64 (3.5.3-1) ... Selecting previously unselected package dh-python. Preparing to unpack .../7-dh-python_2.20170125_all.deb ... Unpacking dh-python (2.20170125) ... Setting up libpython3.5-minimal:amd64 (3.5.3-1+deb9u5) ... Setting up python3.5-minimal (3.5.3-1+deb9u5) ... Setting up python3-minimal (3.5.3-1) ... Selecting previously unselected package python3. (Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 16020 files and directories currently installed.) Preparing to unpack .../python3_3.5.3-1_amd64.deb ... Unpacking python3 (3.5.3-1) ... Selecting previously unselected package distro-info-data. Preparing to unpack .../distro-info-data_0.36_all.deb ... Unpacking distro-info-data (0.36) ... Selecting previously unselected package lsb-release. Preparing to unpack .../lsb-release_9.20161125_all.deb ... Unpacking lsb-release (9.20161125) ... Processing triggers for mime-support (3.60) ... Setting up distro-info-data (0.36) ... Processing triggers for libc-bin (2.24-11+deb9u4) ... Setting up libmpdec2:amd64 (2.4.2-1) ... Setting up libpython3.5-stdlib:amd64 (3.5.3-1+deb9u5) ... Setting up python3.5 (3.5.3-1+deb9u5) ... Setting up libpython3-stdlib:amd64 (3.5.3-1) ... Setting up python3 (3.5.3-1) ... running python rtupdate hooks for python3.5... running python post-rtupdate hooks for python3.5... Setting up lsb-release (9.20161125) ... Setting up dh-python (2.20170125) ... Processing triggers for libc-bin (2.24-11+deb9u4) ... Removing intermediate container d889af6f0374 ---> 43172305e35f Step 7/12 : RUN rm -rf /var/lib/apt/lists/* ---> Running in c446cbbe375f Removing intermediate container c446cbbe375f ---> 91cdd13a9d9f Step 8/12 : COPY . /go/src/github.com/github/freno ---> f00c31db594c Step 9/12 : WORKDIR /go/src/github.com/github/freno ---> Running in d122982b16a2 Removing intermediate container d122982b16a2 ---> 5394c3980258 Step 10/12 : RUN chown -R testuser . ---> Running in 463fea406542 Removing intermediate container 463fea406542 ---> 45fa754df580 Step 11/12 : USER testuser ---> Running in 037acaf47b7c Removing intermediate container 037acaf47b7c ---> a11a4f1a2a09 Step 12/12 : CMD ["script/test"] ---> Running in fa75ac152615 Removing intermediate container fa75ac152615 ---> 8c676e6a5630 Successfully built 8c676e6a5630 Successfully tagged app:latest
Running tests...
Creating network "freno-build-deploy-tarball_default" with the default driver Creating freno-build-deploy-tarball_app_run ... Creating freno-build-deploy-tarball_app_run ... done + echo 'Verifying code is formatted via '\''go fmt'\''' + go fmt ./... Verifying code is formatted via 'go fmt' pkg/throttle/throttler.go + echo Building + script/build Building /usr/local/go/bin/go Running unit tests + echo 'Running unit tests' + go test -covermode=atomic -race ./pkg/... ok github.com/github/freno/pkg/base 0.026s coverage: 21.4% of statements ok github.com/github/freno/pkg/config 0.033s coverage: 50.6% of statements ok github.com/github/freno/pkg/group 0.032s coverage: 2.9% of statements ok github.com/github/freno/pkg/haproxy 0.034s coverage: 73.9% of statements ok github.com/github/freno/pkg/http 0.032s coverage: 27.6% of statements ok github.com/github/freno/pkg/mysql 0.038s coverage: 22.4% of statements ok github.com/github/freno/pkg/proxysql 0.045s coverage: 80.0% of statements ok github.com/github/freno/pkg/throttle 0.032s coverage: 8.8% of statements ok github.com/github/freno/pkg/vitess 0.043s coverage: 97.9% of statements
Creating freno-build-deploy-tarball_app_run ... Creating freno-build-deploy-tarball_app_run ... done /usr/local/go/bin/go bin/ bin/freno
Shutting down services...
Removing freno-build-deploy-tarball_app_run_7cb18be07b65 ... Removing freno-build-deploy-tarball_app_run_7cb18be07b65 ... done Removing network freno-build-deploy-tarball_default
Uploading deployable artifacts...
Gathering artifacts for Octofactory upload... Upload artifacts to Octofactory... Uploaded 821c40ac75705ef01af5a54dd926e15dee555468-focal-x86_64.tar.gz to Octofactory@github-generic-releases-local/builds/freno-build-deploy-tarball/821c40ac75705ef01af5a54dd926e15dee555468/821c40ac75705ef01af5a54dd926e15dee555468-focal-x86_64.tar.gz Set properties on Octofactory@github-generic-releases-local/builds/freno-build-deploy-tarball/821c40ac75705ef01af5a54dd926e15dee555468/821c40ac75705ef01af5a54dd926e15dee555468-focal-x86_64.tar.gz Uploaded 821c40ac75705ef01af5a54dd926e15dee555468-stretch-x86_64.tar.gz to Octofactory@github-generic-releases-local/builds/freno-build-deploy-tarball/821c40ac75705ef01af5a54dd926e15dee555468/821c40ac75705ef01af5a54dd926e15dee555468-stretch-x86_64.tar.gz Set properties on Octofactory@github-generic-releases-local/builds/freno-build-deploy-tarball/821c40ac75705ef01af5a54dd926e15dee555468/821c40ac75705ef01af5a54dd926e15dee555468-stretch-x86_64.tar.gz Finished uploading artifacts! Gathering artifacts for build hosts upload... Uploading artifacts to S3... artifact 821c40ac75705ef01af5a54dd926e15dee555468-focal-x86_64.tar.gz uploaded to s3://bp-artifact-escrow/builds/development/100995152 Published artifact message for 821c40ac75705ef01af5a54dd926e15dee555468-focal-x86_64.tar.gz to the artifacts exchange artifact 821c40ac75705ef01af5a54dd926e15dee555468-stretch-x86_64.tar.gz uploaded to s3://bp-artifact-escrow/builds/development/100995152 Published artifact message for 821c40ac75705ef01af5a54dd926e15dee555468-stretch-x86_64.tar.gz to the artifacts exchange Finished uploading artifacts! Confirming all artifacts have been uploaded to build hosts... Confirmed upload of 821c40ac75705ef01af5a54dd926e15dee555468-stretch-x86_64.tar.gz Confirmed upload of 821c40ac75705ef01af5a54dd926e15dee555468-focal-x86_64.tar.gz Confirmed all artifacts have been uploaded!
Uploading non-deployable artifacts...
Gathering artifacts for Octofactory upload... no artifacts found at /tmp/freno-build-deploy-tarball-artifacts
DNS Capture
===DNS CAPTURE=== { "domains": { "bp-rabbit.service.private-us-east-1.github.net": 2, "github-ci-jenkins-master-logs.s3.amazonaws.com": 8, "github.com": 2, "octofactory.service.private-us-east-1.github.net": 32, "octofactory.githubapp.com": 10, "registry-1.docker.io": 8, "auth.docker.io": 2, "docker.pkg.github.com": 8, "containers.pkg.github.com": 10, "ghcr.io": 10, "octofactory-docker-hub.githubapp.com": 36, "archive.debian.org": 2, "this.should.fail": 2, "this.should.fail.aws.github.net": 2, "bp-artifact-escrow.s3.amazonaws.com": 2 } } ===END DNS CAPTURE===