Publish layer to Gov Cloud regions

[bryantbiggs]

Is your feature request related to a problem? Please describe.

• Consider publishing the layer to the Gov Cloud regions. I checked the list of regions the layer is currently published to but it looks like the Gov Cloud regions are not present.

Describe the solution you'd like

• It would be great if the layer could be published and available in the Gov Cloud regions as well

Describe alternatives you've considered

• For now, I am recommending Gov Cloud users perform a copy of the layer to their account and use that route as a temporary work around

Additional context

[boring-cyborg]

Thanks for opening your first issue here! We'll come back to you as soon as we can.

[heitorlessa]

Thanks a lot for raising this @bryantbiggs - I'm moving to the Roadmap under Backlog as it's something we want to do, but require additional permissions internally given its purpose and regulations.

[heitorlessa]

Update: @am29d is working on migrating our internal Lambda Layers pipeline to CodePipeline in a Powertools AWS account. Once that's done (~H2), we should be able to expand to more AWS regions - that said, GovCloud is a special region and might take longer for us to get approval to do so.

You can follow progress here: https://github.com/orgs/awslabs/projects/51/views/11

[boring-cyborg]

Thanks for opening your first issue here! We'll come back to you as soon as we can.

[kb-fusus]

any updates on this one?

[rubenfonseca]

Hi @kb-fusus I'm actively looking for an update on this, and will get back to you shortly. Publishing the layer to the Gov Cloud regions is a very complex operation, but we're looking to understand the best way to making it work. Thank you for your ping!

[dannellyz]

@rubenfonseca Also wanted to +1 from a customer side how great it would be to have this available in GovCloud. Specifically, the added optimization the team does compared to just pip installing or packaging ourselves would be a huge win. Thanks!

[heitorlessa]

thanks a lot @dannellyz! We're still looking for US specific controls and procedures to work on this.

You could help us prioritize this by sending an email from your corporate address to aws-lambda-powertools-feedback at amazon dot com. We're collecting customer names / gov agencies to help expedite some of these controls.

Thank you!

[dannellyz]

Will do!

[heitorlessa]

Adding this to our public roadmap as of now to make it easier for agencies to reach out to us to help prioritize: https://docs.powertools.aws.dev/lambda/python/stage/roadmap/#lambda-layer-in-govcloud-and-china-region

Sent an internal email asking about GovCloud region requirements to publish this Layer.

[leandrodamascena]

Adding the internal label because we need to handle it internally before making it available for the public.

[leandrodamascena]

Hi everyone, we're still researching this feature. Because of the complexities of GovCloud, this is taking us longer than expected. We'll share any updates as we have them.

Thank you

[jesseadams]

This is exciting! How is it going @sthulb ?

[leandrodamascena]

Hello everyone! We have already deployed the necessary things we need in GovCloud, like OIDC Role, IAM Roles to deploy layers and others. We will start testing with GH Actions + GovCloud and after we release V3 - which is expected in the next 2 weeks - we hope to publish these layers in GovCloud.

Almost there 🚀

[leandrodamascena]

Hello everyone! We released v3.0.0 two days ago and are now working on creating the GitHub Action to publish Lambda layers to the GovCloud partition. You can expect to see this layer in the next two weeks! Many thanks to everyone who gave us some feedback to help prioritize internally and for your great patience while we unblocked things.

[sthulb]

I've created this action: https://github.com/aws-powertools/actions/blob/main/.github/workflows/layer_govcloud.yml which works in beta right now. The plan is to move this to prod soon.

[maxrabin]

Hi, piggybacking here to ask about AWS China partition layer. I don't see anything on the 3.x Roadmap for China (though I do see on the 2.x Roadmap).
I'd love to have a published Lambda Layer for AWS China (both Beijing and Ningxia regions).

[leandrodamascena]

Hi, piggybacking here to ask about AWS China partition layer. I don't see anything on the 3.x Roadmap for China (though I do see on the 2.x Roadmap). I'd love to have a published Lambda Layer for AWS China (both Beijing and Ningxia regions).

Hi @maxrabin! This is something we've been looking into and want to add support for. Can you please open a new issue and tell us a bit about your use case? It can be very superficial, it doesn't need to be super detailed or involve anything confidential. This helps us prioritize internally with requests coming from customers.

Thanks

[maxrabin]

Hi, piggybacking here to ask about AWS China partition layer. I don't see anything on the 3.x Roadmap for China (though I do see on the 2.x Roadmap). I'd love to have a published Lambda Layer for AWS China (both Beijing and Ningxia regions).

Hi @maxrabin! This is something we've been looking into and want to add support for. Can you please open a new issue and tell us a bit about your use case? It can be very superficial, it doesn't need to be super detailed or involve anything confidential. This helps us prioritize internally with requests coming from customers.

Thanks

Hi @leandrodamascena I opened #5269

[github-actions]

⚠️COMMENT VISIBILITY WARNING⚠️

This issue is now closed. Please be mindful that future comments are hard for our team to see.

If you need more assistance, please either tag a team member or open a new issue that references this one.

If you wish to keep having a conversation with other community members under this issue feel free to do so.

[switch-to-gitlab]

@leandrodamascena @sthulb Hello, I see this is pending release. If you don't mind my asking, do you know when we'll see this in our production environments?

I appreciate your work and don't mean to sound impatient! It's just that I rolled the dice and built this dependency into a user story for this sprint, so I want to know if I can deploy to dev on Monday. 😅

[sthulb]

H folks

The issue was closed by virtue of merging a PR, I've reopened it.

We've merged the GovCloud workflow into the develop branch last week and successfully deployed into the GovCloud gamma/beta accounts. The workflow can be observed here: https://github.com/aws-powertools/powertools-lambda-python/actions/workflows/layer_govcloud.yml

Our next steps are to create an internal run book and update the public docs before creating a production release which will hopefully be completed soon.

Thanks everyone for sticking with this.

[sthulb]

We have published GovCloud layers into our PROD account, you can now use them.

You can see the ARN structure here:
https://docs.powertools.aws.dev/lambda/python/latest/#lambda-layer-govcloud

Thanks everyone, I'll leave this open until we're 100% done, we're in the final stretches of it, but the rest is internal.

[github-actions]

This is now released under 3.2.0 version!

[github-actions]

This is now released under 3.3.0 version!