Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disable chaosduck on the webhook #5419

Merged
merged 1 commit into from
May 20, 2021
Merged

Disable chaosduck on the webhook #5419

merged 1 commit into from
May 20, 2021

Conversation

benmoss
Copy link
Member

@benmoss benmoss commented May 19, 2021

Serving has done this as well, the chaosduck killing the webhook causes errors being tracked in knative/pkg#1509

ref: knative/serving#8772

Fixes #5416, probably lots of others 😄

@google-cla google-cla bot added the cla: yes Indicates the PR's author has signed the CLA. label May 19, 2021
@knative-prow-robot knative-prow-robot added area/test-and-release Test infrastructure, tests or release size/XS Denotes a PR that changes 0-9 lines, ignoring generated files. labels May 19, 2021
@codecov
Copy link

codecov bot commented May 19, 2021

Codecov Report

Merging #5419 (71b95b8) into main (453e4c0) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main    #5419   +/-   ##
=======================================
  Coverage   82.62%   82.62%           
=======================================
  Files         194      194           
  Lines        5987     5987           
=======================================
  Hits         4947     4947           
  Misses        717      717           
  Partials      323      323           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 453e4c0...71b95b8. Read the comment docs.

Copy link
Member

@pierDipi pierDipi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks, one minor comment.

There is another webhook inmemorychannel-webhook :

service:
name: inmemorychannel-webhook
namespace: knative-eventing

service:
name: inmemorychannel-webhook
namespace: knative-eventing

which points to imc-controller, which is already disabled due to another issue #3590

test/config/chaosduck/chaosduck.yaml Outdated Show resolved Hide resolved
@dprotaso
Copy link
Member

dprotaso commented May 19, 2021

@benmoss can you do me a favour and bump the timeout in a separate PR and see if the flake still occurs after some time

https://github.com/knative/eventing/blob/main/config/core/webhooks/defaulting.yaml#L30

I noticed Istio has their timeout set to 30s.

@benmoss
Copy link
Member Author

benmoss commented May 19, 2021

weird that we are still seeing EOFs on this PR even, maybe this isn't the fix we need

/test pull-knative-eventing-reconciler-tests

Copy link
Member

@pierDipi pierDipi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/retest

@knative-prow-robot knative-prow-robot added the lgtm Indicates that a PR is ready to be merged. label May 19, 2021
@knative-prow-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: pierDipi

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@knative-prow-robot knative-prow-robot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label May 19, 2021
@pierDipi
Copy link
Member

/hold

@knative-prow-robot knative-prow-robot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label May 19, 2021
Serving has done this as well, the chaosduck killing the webhook causes
errors being tracked in knative/pkg#1509
@knative-prow-robot knative-prow-robot removed the lgtm Indicates that a PR is ready to be merged. label May 19, 2021
@benmoss
Copy link
Member Author

benmoss commented May 19, 2021

I had a subtle mistake: "disable=eventing-webhook", was missing the - before disable

@benmoss
Copy link
Member Author

benmoss commented May 19, 2021

let's run this a few times and see that it seems stable

@pierDipi
Copy link
Member

/lgtm

unhold once you're ready to merge this.

@knative-prow-robot knative-prow-robot added the lgtm Indicates that a PR is ready to be merged. label May 19, 2021
@pierDipi
Copy link
Member

pierDipi commented May 19, 2021

Worked, retesting
/test pull-knative-eventing-reconciler-tests

@matzew
Copy link
Member

matzew commented May 20, 2021

@benmoss any comments on Dave's suggestion:
#5419 (comment)

@benmoss
Copy link
Member Author

benmoss commented May 20, 2021

I don't really understand why increasing the timeout would fix things, it's not a timeout issue but an EOF on an open connection

@benmoss
Copy link
Member Author

benmoss commented May 20, 2021

/test pull-knative-eventing-reconciler-tests

@benmoss
Copy link
Member Author

benmoss commented May 20, 2021

/hold cancel

@knative-prow-robot knative-prow-robot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label May 20, 2021
@knative-prow-robot knative-prow-robot merged commit 869220a into knative:main May 20, 2021
@benmoss benmoss deleted the rekt-chaosduck branch May 20, 2021 16:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. area/test-and-release Test infrastructure, tests or release cla: yes Indicates the PR's author has signed the CLA. lgtm Indicates that a PR is ready to be merged. size/XS Denotes a PR that changes 0-9 lines, ignoring generated files.
Projects
None yet
5 participants