Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add AWS VPC and EKS reference resources for Karpenter #24

Closed
wants to merge 33 commits into from
Closed

add AWS VPC and EKS reference resources for Karpenter #24

wants to merge 33 commits into from

Conversation

lpm0073
Copy link
Contributor

@lpm0073 lpm0073 commented Mar 6, 2023

For issue #7: refactor the new infra-example folder into infra-examples, and add Terraform modules for AWS reference resources.

Adds generic AWS Virtual Private Cloud and Elastic Kubernetes Service modules, both of which are preconfigured as necessary to support use of Karpenter for node auto-scaling and pod bin packing.

@openedx-webhooks openedx-webhooks added the open-source-contribution PR author is not from Axim or 2U label Mar 6, 2023
@openedx-webhooks
Copy link

Thanks for the pull request, @lpm0073! Please note that it may take us up to several weeks or months to complete a review and merge your PR.

Feel free to add as much of the following information to the ticket as you can:

  • supporting documentation
  • Open edX discussion forum threads
  • timeline information ("this must be merged by XX date", and why that is)
  • partner information ("this is a course on edx.org")
  • any other information that can help Product understand the context for the PR

All technical communication about the code itself will be done via the GitHub pull request interface. As a reminder, our process documentation is here.

Please let us know once your PR is ready for our review and all tests are green.

@bradenmacdonald
Copy link
Contributor

bradenmacdonald commented Mar 7, 2023

@gabor-boros @jfavellar90 please review once it's ready for review.

@itsjeyd itsjeyd added the needs test run Author's first PR to this repository, awaiting test authorization from Axim label Mar 8, 2023
@e0d
Copy link

e0d commented Mar 8, 2023

@lpm0073 can you amend the commit messages to follow our conventional commit standard? https://open-edx-proposals.readthedocs.io/en/latest/best-practices/oep-0051-bp-conventional-commits.html#type

@e0d e0d removed the needs test run Author's first PR to this repository, awaiting test authorization from Axim label Mar 8, 2023
@itsjeyd
Copy link

itsjeyd commented Mar 14, 2023

@lpm0073 Thank you for your contribution!

In addition to changing the commit messages as @e0d mentioned above, it would be great if you could bring your branch up-to-date with the main branch.

Once that's done this PR will be ready for engineering review.

@itsjeyd itsjeyd added the waiting on author PR author needs to resolve review requests, answer questions, fix tests, etc. label Mar 14, 2023
@itsjeyd
Copy link

itsjeyd commented Mar 21, 2023

Hey @lpm0073, a friendly reminder to follow up on the comments above.

@gabor-boros
Copy link
Contributor

@bradenmacdonald If I understand correctly, I would need to be a core contributor to review this, which would require a 20h commitment , that I have concerns with from Serenity point of view at the moment. Ref: #25 (comment)

@bradenmacdonald
Copy link
Contributor

@lpm0073 said on today's call that he is still finding a way to refactor this, to improve the design/code.

@antoviaque
Copy link

@gabor-boros +1 to what @bradenmacdonald said - you don't need to be a core contributor to do the review. Could you schedule the review when it's ready?

@gabor-boros
Copy link
Contributor

@antoviaque @bradenmacdonald Cool! Whenever @lpm0073 says it is ready, I'll schedule a review for it.

@lpm0073
Copy link
Contributor Author

lpm0073 commented Apr 4, 2023

The code itself is final. I was unsatisfied with alternative approaches for various reasons. @e0d asked me to modify the commit comments so that these conform to a tCRIL standard. This is still pending. I'll take care of this later today.

@itsjeyd
Copy link

itsjeyd commented Apr 20, 2023

Hey @lpm0073, it looks like this PR will need a rebase. Once that's done and the commit linter check passes we'll line it up for engineering review.

Copy link
Contributor

@gabor-boros gabor-boros left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lpm0073 I just checked the PR. Very nice work on this!

I mostly have suggestions to bump version numbers, questions about using SSM and some smaller things.

.gitignore Show resolved Hide resolved
README.md Show resolved Hide resolved
README.md Show resolved Hide resolved
infra-examples/aws/k8s-cluster/README.rst Show resolved Hide resolved
infra-examples/aws/main.tf Outdated Show resolved Hide resolved
infra-examples/aws/vpc/main.tf Outdated Show resolved Hide resolved
infra-examples/aws/vpc/versions.tf Outdated Show resolved Hide resolved
infra-examples/aws/vpc/versions.tf Outdated Show resolved Hide resolved
infra-examples/aws/k8s-cluster/versions.tf Outdated Show resolved Hide resolved
@itsjeyd
Copy link

itsjeyd commented May 31, 2023

Hi @lpm0073, just checking in to see if you're still planning to work on this PR?

@lpm0073
Copy link
Contributor Author

lpm0073 commented May 31, 2023 via email

@itsjeyd
Copy link

itsjeyd commented Jun 7, 2023

@lpm0073 It looks like there's three things to follow up on:

Once that's done we can line this up for another review pass.

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 7, 2023

got it, thanks @itsjeyd. I hope to be able to take care of all three later today.

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 7, 2023

@lpm0073 can you amend the commit messages to follow our conventional commit standard? https://open-edx-proposals.readthedocs.io/en/latest/best-practices/oep-0051-bp-conventional-commits.html#type

editing these now.

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 7, 2023

@lpm0073 It looks like there's three things to follow up on:

Once that's done we can line this up for another review pass.

these are done.

@itsjeyd
Copy link

itsjeyd commented Jun 15, 2023

Thanks for the updates @lpm0073!

It looks like latest master was updated with one or more additional changes that are conflicting/overlapping with the changes from this PR.

@gabor-boros To keep things efficient, could we schedule your next review pass for a certain date? That way @lpm0073 would only need to resolve the remaining conflicts one more time (= right before you take another look at the changes).

@itsjeyd itsjeyd removed the waiting on author PR author needs to resolve review requests, answer questions, fix tests, etc. label Jun 15, 2023
@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 15, 2023

Thanks, that would be ideal.

@gabor-boros
Copy link
Contributor

@itsjeyd Sure! I'm going to review this today to speed things up!

Copy link
Contributor

@gabor-boros gabor-boros left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lpm0073 I just finished reviewing this. I think after a rebase onto latest master branch, this could be merged.

After rebasing, I'm going to test the changes by running terraform, so we can make sure the infra is created properly before merging, but since I'm not expecting any more change requests, I'm giving my approval here.

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 19, 2023

merge conflicts are resolved. Please merge this PR at your earliest convenience.

@gabor-boros
Copy link
Contributor

@lpm0073 Thanks for resolving! I'm going to take the chance to setup a test cluster and merge the MR 😇

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 19, 2023

My commit message is improperly formatted 🤦

@gabor-boros
Copy link
Contributor

I guess "feat: implement Karpenter example" would be a good squash commit message that should pass the test too

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 19, 2023

yes, perfect :)

@lpm0073
Copy link
Contributor Author

lpm0073 commented Jun 19, 2023

this seems kind of unfair. this is a commit that trickled in from the rebase i did last night.

Screenshot 2023-06-19 at 10 09 11

@gabor-boros
Copy link
Contributor

Eh, kind of rewording solves the issue, but indeed unfair. I ran out of time today, but will take care of this this week 😇

@bradenmacdonald
Copy link
Contributor

@gabor-boros friendly reminder to fix the commit msgs and merge this PR for @lpm0073 please :)

@jfavellar90
Copy link
Contributor

jfavellar90 commented Jun 27, 2023

@bradenmacdonald @lpm0073 could we just merge #40 before this one? Once #40 is merged, I will rebase and apply some changes to this PR in order to create a new Harmony chart release. I can fix the commit lint issue as well

@bradenmacdonald
Copy link
Contributor

@jfavellar90 That's fine with me. Thanks for volunteering to do the rebase!

@itsjeyd itsjeyd added the waiting on author PR author needs to resolve review requests, answer questions, fix tests, etc. label Jul 5, 2023
@itsjeyd
Copy link

itsjeyd commented Jul 11, 2023

Hey @lpm0073 @jfavellar90, now that #40 has been merged and #41 is up, I'm closing this as a duplicate. Let me know if that's not what you had in mind.

@itsjeyd itsjeyd closed this Jul 11, 2023
@openedx-webhooks
Copy link

@lpm0073 Even though your pull request wasn’t merged, please take a moment to answer a two question survey so we can improve your experience in the future.

@itsjeyd itsjeyd added duplicate This issue or pull request already exists elsewhere and removed waiting on author PR author needs to resolve review requests, answer questions, fix tests, etc. labels Jul 11, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
duplicate This issue or pull request already exists elsewhere open-source-contribution PR author is not from Axim or 2U
Projects
Archived in project
Development

Successfully merging this pull request may close these issues.

9 participants