Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Migracao inicial #2

Merged
merged 121 commits into from
Oct 10, 2024
Merged

Migracao inicial #2

merged 121 commits into from
Oct 10, 2024

Conversation

patriciacatandi
Copy link
Contributor

No description provided.

PedroSiqueira1 and others added 30 commits September 2, 2024 16:38
@PedroSiqueira1
feat: Add gdal to pyproject
82cca31
@PedroSiqueira1
bugfix: Add gdal version to poetry
c815ddb
@PedroSiqueira1
fix: Add GDAL dependencies to Dockerfile
36f3458
@PedroSiqueira1
fix: Trying curl in dockerfile
52c8ce3
@PedroSiqueira1
fix: Install libgdal in docker file
dad88a1
@PedroSiqueira1
fix: Add g++ to Docker
85082a7
@PedroSiqueira1
fix: Add C envs
268ab13
@PedroSiqueira1
fix: Back to python 3.9 to get gdal to work
e53a650
@PedroSiqueira1
fix: Change base stages
5e82779
@PedroSiqueira1
fix: Add path to wheel
5bc413d
@PedroSiqueira1
fix: Update cd_staging to use 3.9
7400f53
@PedroSiqueira1
fix: Add flows to __init__
381c349
@PedroSiqueira1
fix: Change init.py to add flows
2fce9bc
@PedroSiqueira1
fix: Change flow imports
3e4e908
@PedroSiqueira1
fix: Add ignore to flake8
f705505
@PedroSiqueira1
fix: Add W503 to flake8 ignore
cabccdd
@PedroSiqueira1
fix: Add version to docker file and remove environment from workflows
99977af
@gabriel-milan
Merge branch 'main' into staging/migracao-inicial
1b63e2a
@PedroSiqueira1
fix: Change label name from rj-cor to cor to match prefect agent
b562446
@PedroSiqueira1
fix: Add openpyxl to poetry
87c81b8
@PedroSiqueira1
Dummy commiy to readd flows
64013e1
@gabriel-milan
fix: repo structure, add state handlers
aead2e2
@gabriel-milan
chore: update prefeitura-rio version
81acd7d
@gabriel-milan
chore: remove flow
fda87e5
@gabriel-milan
fix: flow imports
3ec0c74
@PedroSiqueira1
fix: Add new connection to redis
c6ab5a6
@PedroSiqueira1
fix: circular dependency
db66764
@PedroSiqueira1
Dummy commit
f85630e
@PedroSiqueira1
Dummy commit to fix infisical
5bcc05a
@PedroSiqueira1
fix: Change Vault for Infisical Acess
e084552
PedroSiqueira1 and others added 26 commits September 30, 2024 15:51
@PedroSiqueira1
fix: Convert byte to string
a8822c5
@PedroSiqueira1
fix: Change project from rain_dashboard
3ded82f
@PedroSiqueira1
fix: change label rain_dashboard to cor
c968449
@PedroSiqueira1
fix: change schedule label
f2d8e32
@PedroSiqueira1
fix: Change label flows again
4870035
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
f448fe6 
for more information, see https://pre-commit.ci
@PedroSiqueira1
Fix: Add contextily and change branch prefeiturario
d637308
@PedroSiqueira1
test: test dask executor again
20043fb
@PedroSiqueira1
fix: Change DBT flow project
032e9b2
@PedroSiqueira1
feat: Add execute dbt model
163e78f
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
3060371 
for more information, see https://pre-commit.ci
@PedroSiqueira1
fix: Add dbt_client to project
cdc8c87
@PedroSiqueira1
fix: change labels and project for execute_dbt_model
2d481c3
@PedroSiqueira1
fix: Add utils flows
3811c59
@PedroSiqueira1
Merge branch 'main' of https://github.com/prefeitura-rio/pipelines_rj…
236a8d1 
…_cor into staging/migracao-inicial
@PedroSiqueira1
fix: trying to fix google cloud
199d244
@PedroSiqueira1
fix: change inea flow to be like alertario
1361ba1
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
d58abdc 
for more information, see https://pre-commit.ci
@PedroSiqueira1
fix: change dbt redemet
6ccb5cb
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
e0fdcb1 
for more information, see https://pre-commit.ci
@PedroSiqueira1
fix: change websirene flow to prod
74408ab
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
0ed5a47 
for more information, see https://pre-commit.ci
@PedroSiqueira1
fix: change websirene schedule
0dd811a
@pre-commit-ci
[pre-commit.ci] auto fixes from pre-commit.com hooks
b87e914 
for more information, see https://pre-commit.ci
@gabriel-milan
chore: dummy commit for registering
e5f28a6
@gabriel-milan
chore: update prefeitura-rio version
c676f50
@github-actions GitHub Actions
Copy link

github-actions bot commented Oct 9, 2024

Análise da árvore de código

Os seguintes arquivos são afetados diretamente por alterações realizadas nesse pull request:
- pipelines/utils/dump_db/utils.py
- pipelines/flows.py
- pipelines/utils/execute_dbt_model/__init__.py
- pipelines/meteorologia/meteorologia_redemet/flows.py
- pipelines/meteorologia/precipitacao_cemaden/schedules.py
- pipelines/utils_rj_cor.py
- pipelines/meteorologia/precipitacao_inea/tasks.py
- pipelines/meteorologia/satelite/schedules.py
- pipelines/constants.py
- pipelines/templates/run_dbt_model/flows.py
- pipelines/rj_escritorio/rain_dashboard/schedules.py
- pipelines/meteorologia/precipitacao_websirene/tasks.py
- pipelines/meteorologia/precipitacao_inea/__init__.py
- pipelines/utils/custom.py
- pipelines/meteorologia/radar/mendanha/schedules.py
- pipelines/utils/tasks.py
- pipelines/meteorologia/precipitacao_inea/flows.py
- pipelines/meteorologia/satelite/flows.py
- pipelines/tasks.py
- pipelines/meteorologia/meteorologia_inmet/tasks.py
- pipelines/meteorologia/radar/mendanha/flows.py
- pipelines/meteorologia/precipitacao_alertario/schedules.py
- pipelines/meteorologia/precipitacao_cemaden/flows.py
- pipelines/utils/__init__.py
- pipelines/utils/execute_dbt_model/utils.py
- pipelines/meteorologia/meteorologia_inmet/flows.py
- pipelines/meteorologia/precipitacao_websirene/flows.py
- pipelines/utils/execute_dbt_model/tasks.py
- pipelines/meteorologia/meteorologia_inmet/schedules.py
- pipelines/rj_escritorio/rain_dashboard/tasks.py
- pipelines/utils/dump_to_gcs/tasks.py
- pipelines/utils/dump_db/tasks.py
- pipelines/meteorologia/radar/mendanha/tasks.py
- pipelines/rj_escritorio/__init__.py
- pipelines/meteorologia/precipitacao_inea/schedules.py
- pipelines/utils/dump_db/__init__.py
- pipelines/meteorologia/__init__.py
- pipelines/meteorologia/meteorologia_redemet/schedules.py
- pipelines/meteorologia/meteorologia_redemet/tasks.py
- pipelines/utils/execute_dbt_model/flows.py
- pipelines/meteorologia/precipitacao_websirene/schedules.py
- pipelines/utils/dump_db/db.py
- pipelines/rj_escritorio/rain_dashboard/__init__.py
- pipelines/utils/dump_db/flows.py
- pipelines/utils/dump_to_gcs/__init__.py
- pipelines/meteorologia/precipitacao_alertario/flows.py
- pipelines/utils/utils.py
- pipelines/utils/dump_to_gcs/flows.py
- pipelines/meteorologia/utils.py
- pipelines/rj_escritorio/rain_dashboard/flows.py
- pipelines/meteorologia/precipitacao_cemaden/tasks.py
- pipelines/meteorologia/precipitacao_alertario/tasks.py

@PedroSiqueira1
Copy link
Collaborator

Adicionando os seguintes flows:

  • meteorologia_inmet
  • meteorologia_redemet
  • precipitacao_alertario
  • precipitacao_inea
  • precipitacao_websirene

Faltando apenas adicionar o flow precipitacao_cemaden, que será adicionado no futuro quando resolvermos a questão da API inacessível.

@PedroSiqueira1 PedroSiqueira1 merged commit 360168f into main Oct 10, 2024
7 of 8 checks passed
@PedroSiqueira1 PedroSiqueira1 deleted the staging/migracao-inicial branch October 10, 2024 12:51
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
migracao-prefect
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@patriciacatandi @PedroSiqueira1 @gabriel-milan