chores: update dict (#192)

* chores: update dict * review * chores: update dependencies
dataforgoodfr · Jun 25, 2024 · 665288d · 665288d · github-actions · Jun 25, 2024
1 parent aa8823f
commit 665288d
Show file tree

Hide file tree

Showing 10 changed files with 5,647 additions and 2,107 deletions.
diff --git a/README.md b/README.md
@@ -338,10 +338,10 @@ In order to maintain channel perimeter (weekday, hours) up to date, we save the
 ## Keywords
 ## Produce keywords list from Excel files
 How to update `quotaclimat/data_processing/mediatree/keyword/keyword.py` from shared excel files ?
-Download files locally then :
+Download files locally to "document-experts" from Google Drive (ask on Slack) then :
 ```
-poetry run python3 quotaclimat/transform_excel_to_json.py > cc-bio.json
-# then update quotaclimat/data_processing/mediatree/keyword/keyword.py list
+# Be sure to have updated the folder "document-experts" before running it :
+poetry run python3 quotaclimat/transform_excel_to_json.py
 ```
 
 ## Program Metadata table

diff --git a/document-experts/.download-from-gdrive.empty b/document-experts/.download-from-gdrive.empty
diff --git a/poetry.lock b/poetry.lock
diff --git a/pyproject.toml b/pyproject.toml
@@ -27,14 +27,14 @@ aiohttp = "^3.8.6"
 pytest-asyncio = "^0.23.5"
 swifter = "^1.4.0"
 tenacity = "^8.2.3"
-sentry-sdk = "^1.44.1"
-coverage = "^7.4.2"
+sentry-sdk = "^2.6.0"
 modin = {extras = ["ray"], version = "^0.30.1"}
 [build-system]
 requires = ["poetry-core>=1.1"]
 build-backend = "poetry.core.masonry.api"
 
 [tool.poetry.group.dev.dependencies]
+coverage = "^7.5.4"
 pytest = "^8.1.1"
 pytest-cov = "^5.0.0"
 poetry-bumpversion = "^0.3.1"
File	Stmts	Miss	Cover	Missing
postgres
insert_data.py	44	7	84%	36–38, 57–59, 64
insert_existing_data_example.py	19	3	84%	25–27
postgres/schemas
models.py	146	10	93%	120–127, 139–140, 198–199, 213–214
quotaclimat/data_ingestion
scrap_sitemap.py	134	17	87%	27–28, 33–34, 66–71, 95–97, 138–140, 202, 223–228
quotaclimat/data_ingestion/ingest_db
ingest_sitemap_in_db.py	55	37	33%	21–42, 45–58, 62–73
quotaclimat/data_ingestion/scrap_html
scrap_description_article.py	36	3	92%	19–20, 32
quotaclimat/data_processing/mediatree
api_import.py	204	127	38%	43–47, 52–67, 71–74, 80, 83–122, 128–143, 147–148, 161–173, 177–183, 196–207, 210–214, 220, 255–256, 260, 264–298, 301–303
channel_program.py	136	51	62%	30–32, 43–45, 59, 95, 104, 142–183
config.py	15	2	87%	7, 16
detect_keywords.py	213	8	96%	169–172, 216, 271–273
update_pg_keywords.py	52	37	29%	14–97, 120–121, 144–170, 176
utils.py	64	22	66%	26–50, 53, 62, 78–79
quotaclimat/utils
healthcheck_config.py	29	14	52%	22–24, 27–38
logger.py	24	11	54%	22–24, 28–37
sentry.py	10	2	80%	21–22
TOTAL	1207	351	71%