Skip to content

Commit

Permalink
Fixing Secrets Issue on TF (#204)
Browse files Browse the repository at this point in the history
* predicting for only the users with traffic in the past 72h - purchase propensity

* running inference only for users events in the past 72h

* including 72h users for all models predictions

* considering null values in TabWorkflow models

* deleting unused pipfile

* upgrading lib versions

* implementing reporting preprocessing as a new pipeline

* adding more code documentation

* adding important information on the main README.md and DEVELOPMENT.md

* adding schedule run name and more code documentation

* implementing a new scheduler using the vertex ai sdk & adding user_id to procedures for consistency

* adding more code documentation

* adding code doc to the python custom component

* adding more code documentation

* fixing aggregated predictions query

* removing unnecessary resources from deployment

* Writing MDS guide

* adding the MDS developer and troubleshooting documentation

* fixing deployment for activation pipelines and gemini dataset

* Update README.md

* Update README.md

* Update README.md

* Update README.md

* removing deprecated api

* fixing purchase propensity pipelines names

* adding extra condition for when there is not enough data for the window interval to be applied on backfill procedures

* adding more instructions for post deployment and fixing issues when GA4 export was configured for less than 10 days

* removing unnecessary comments

* adding the number of past days to process in the variables files

* adding comment about combining data from different ga4 export datasets to data store

* fixing small issues with feature engineering and ml pipelines

* fixing hyper parameter tuning for kmeans modeling

* fixing optuna parameters

* adding cloud shell image

* fixing the list of all possible users in the propensity training preparation tables

* additional guardrails for when there is not enough data

* adding more documentation

* adding more doc to feature store

* add feature store documentation

* adding ml pipelines docs

* adding ml pipelines docs

* adding more documentation

* adding user agent client info

* fixing scope of client info

* fix

* removing client_info from vertex components

* fixing versioning of tf submodules

* reconfiguring meta providers

* fixing issue 187

* chore(deps): upgrade terraform providers and modules version

* chore(deps): set the provider version

* chore: formatting

* fix: brand naming

* fix: typo

* fixing secrets issue

---------

Co-authored-by: Carlos Timoteo <[email protected]>
Co-authored-by: Laurent Grangeau <[email protected]>
  • Loading branch information
3 people authored Oct 4, 2024
1 parent c080643 commit 272ffeb
Show file tree
Hide file tree
Showing 3 changed files with 11 additions and 5 deletions.
11 changes: 9 additions & 2 deletions infrastructure/terraform/.terraform.lock.hcl

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

2 changes: 1 addition & 1 deletion infrastructure/terraform/modules/data-store/main.tf
Original file line number Diff line number Diff line change
Expand Up @@ -21,7 +21,7 @@ data "google_project" "data_processing" {
}

data "google_secret_manager_secret" "github_secret_name" {
secret_id = google_secret_manager_secret.github-secret.name
secret_id = google_secret_manager_secret.github-secret.secret_id
project = var.data_processing_project_id
}

Expand Down
3 changes: 1 addition & 2 deletions infrastructure/terraform/modules/data-store/secretmanager.tf
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,6 @@ resource "google_secret_manager_secret" "github-secret" {
project = null_resource.check_secretmanager_api.id != "" ? module.data_processing_project_services.project_id : data.google_project.data_processing.project_id

replication {
#automatic = true
auto {}
}

Expand All @@ -28,7 +27,7 @@ resource "google_secret_manager_secret" "github-secret" {
}

resource "google_secret_manager_secret_version" "secret-version-github" {
secret = google_secret_manager_secret.github-secret.id
secret = google_secret_manager_secret.github-secret.secret_id
secret_data = var.dataform_github_token

#deletion_policy = "DISABLE"
Expand Down

0 comments on commit 272ffeb

Please sign in to comment.