johanleroy/ENI-projet-piscine
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

fix(etl): traite les retours de revue du DAG historique
Airflow / Lint et intégrité des DAGs (push) Successful in 57s
Details
Airflow / Construction de l'image (push) Successful in 2m52s
Details
SonarQube / build-back (push) Successful in 1m17s
Details
SonarQube / test-ml (push) Failing after 1m50s
Details
SonarQube / build-front (push) Successful in 9m44s
Details
SonarQube / test-back (push) Failing after 55s
Details
SonarQube / test-front (push) Failing after 5m3s
Details
SonarQube / SonarQube (push) Skipped
Details

Browse Source
This commit is contained in:
Meryemel-gham
2026-09-21 16:05:55 +02:00
parent cb4df846cb
commit fe100653d0
5 changed files with 115 additions and 515 deletions
Download Patch File Download Diff File Expand all files Collapse all files
etl/airflow/dags/historical_import.py
+2
View File
@@ -18,6 +18,8 @@ COMMANDE_BACKEND = "cd /opt/backend && env -u VIRTUAL_ENV uv run --no-sync pytho
CSV_PATH = "/opt/data/raw/all_sites_combined.csv"
METADATA_PATH = "/opt/data/raw/dataset_metadata.json"
SOURCE_TIMEZONE = "UTC"
BATCH_SIZE = 1000
with DAG(
dag_id="historical_import",