-
Notifications
You must be signed in to change notification settings - Fork 15.9k
Closed
Labels
area:providerskind:metaHigh-level information important to the communityHigh-level information important to the communitytesting statusStatus of testing releasesStatus of testing releases
Description
Body
I have a kind request for all the contributors to the latest provider distributions release.
Could you please help us to test the RC versions of the providers?
The guidelines on how to test providers can be found in
Verify providers by contributors
Let us know in the comments, whether the issue is addressed.
These are providers that require testing as there were some substantial changes introduced:
Provider alibaba: 3.0.2rc1
- Add
tito the RemoteLogIO read and upload methods (#48804): @ashb - Rework remote task log handling for the structlog era. (#48491): @ashb
Provider amazon: 9.5.0rc3
- Add a backup implementation in AWS MwaaHook for calling the MWAA API (#47035): @ramitkataria
- Add AWS SageMaker Unified Studio Workflow Operator (#45726): @agupta01
- Add error statuses check in RdsExportTaskExistenceSensor (#46917): @vargacypher
- Draft Common Message Queue (#46694): @vikramkoka
- add startTime to paginator.paginate when fetching logs in GlueJobHook (#46950): @rawwar
- Add MwaaDagRunSensor to Amazon Provider Package (#46945): @ramitkataria
- Add wait/defer support - MwaaTriggerDagRunOperator (#47528): @ramitkataria
- Add deferrable support for MwaaDagRunSensor (#47527): @ramitkataria
- Fix aws trigger tests, use get_async_conn for mock object (#47515): @gopidesupavan
- fix: don't use blocking property access for async purposes (#47326): @m1racoli
- Fix and simplify
get_permitted_dag_idsin auth manager (#47458): @vincbeck - Log state for EMR Containers sensor on failure (#47125): @o-nikolas
- Don't expect default conns in s3_to_redshift (#48363): @o-nikolas
Linked issues: - Don't expect default connections to be present (#47968): @o-nikolas
- fix PosixPath not working with file create_asset (#47880): @mobuchowski
- Fix Cloudwatch remote logging (#48774): @o-nikolas
- Fix
conf.get_boolean("api", "ssl_cert")(#48465): @vincbeck - Fix signature of
BatchWaitersHook.get_waiternot matching parent class (#48581): @vincbeck
Linked issues: - Add some typing and require kwargs for auth manager (#47455): @jedcunningham
- Base AWS classes - S3 (#47321): @o-nikolas
Linked issues: - Remove unused methods from auth managers (#47316): @vincbeck
- Updating EC2 Operators and Sensors with AWS Base classes (#47931): @ellisms
- Fix mypy boto3 appflow version (#47912): @simonprydden
Linked issues: - Clarify the Redshift delete cluster operator messaging. (#48652): @ferruzzi
- Rework remote task log handling for the structlog era. (#48491): @ashb
- Move
BaseSensorOperatorto TaskSDK definitions (#48244): @kaxil - Cookies in non TLS mode (#48453): @pierrejeambrun
Provider apache.hive: 9.0.5rc1
- Fix MyPy failing on mssql Cursor (#48686): @potiuk
- Tell mypy that pymssql.BINARY, etc have a .value (#48671): @amoghrajesh
Provider apache.livy: 4.3.0rc1
Provider celery: 3.10.5rc1
- Fix Celery Executor on Airflow 2.x again. (#48806): @ashb
Linked issues: - Remove change_sensor_mode_to_reschedule from base executor (#48649): @jaketf
- Update min version of Celery library to 5.5.0 (#43777): @eladkal
Provider cncf.kubernetes: 10.4.1rc1
- Handle missing container_statuses in pod_manager.get_container_status (#47936): @ForeverWintr
- Remove change_sensor_mode_to_reschedule from base executor (#48649): @jaketf
- No need to exclude executor_config specifically for KE (#48826): @amoghrajesh
Linked issues:
Provider common.messaging: 1.0.0rc1
Provider common.sql: 1.25.0rc1
- Add requires_result_fetch Configuration to SQLExecuteQueryOperator (#46997): @EdenKik
Linked issues:
Provider databricks: 7.3.0rc1
- Add DatabricksSQLStatementsOperator (#48507): @pankajkoti
Linked issues:
Provider dbt.cloud: 4.3.2rc1
Provider exasol: 4.7.4rc1
Provider fab: 2.0.0rc3
- Prepare FAB provider to set next version as major version (#43939): @vincbeck
- Remove deprecations from fab provider (#44198): @vincbeck
- Set up JWT token authentication in Fast APIs (#42634): @vincbeck
- AIP-79 Support Airflow 2.x plugins in fast api (#44464): @vincbeck
- AIP-81 Move CLI Commands to directories according to Hybrid, Local and Remote (#44538): @bugraoz93
Linked issues: - (Re)move old dependencies from the old FAB UI (#48007): @ashb
- AIP 84 - Add auth for asset alias (#47241): @rawwar
- AIP-38 Fix safari login loop for non ssl (#47859): @pierrejeambrun
- AIP-38 Move token handling to axios interceptor (#47562): @pierrejeambrun
- AIP-72: Handle Custom XCom Backend on Task SDK (#47339): @amoghrajesh
Linked issues: - AIP-79 Generate assets for Flask application in FAB provider (#44744) (#45060): @vincbeck
Linked issues: - AIP-81 | AIP-84 | Include Token Generation Endpoints in FAB (#47043): @bugraoz93
Linked issues: - AIP-81: Flatten core CLI commands (#48224): @jedcunningham
- AIP-83 amendment: Add logic for generating run_id when logical date is None. (#46616): @sunank200
- AIP-84 Add Auth for DAG Versioning (#47553): @vatsrahul1001
- AIP-84 Add Auth for backfill (#47482): @vatsrahul1001
- Add
get_menu_itemsin auth manager interface to extend the menu (#47468): @vincbeck
Linked issues: - Add
logoutmethod in auth manager interface (#47573): @vincbeck
Linked issues: - Add AWS SageMaker Unified Studio Workflow Operator (#45726): @agupta01
- Add authentication section in FAB auth manager API documentation (#48455): @vincbeck
- Add back
get_url_logoutin auth managers but make it optional (#47729): @vincbeck
Linked issues: - Add legacy namespace packages to airflow.providers (#47064): @potiuk
- Add missing methods in fab provider's AirflowAppBuilder class (#45611): @utkarsharma2
- Add option in auth manager interface to define FastAPI api (#45009): @vincbeck
Linked issues: - Add option in auth managers to specify DB manager (#48196): @vincbeck
- Add run_after column to DagRun model (#45732): @uranusjr
- Add some typing and require kwargs for auth manager (#47455): @jedcunningham
- Avoid imports from "providers" (#46801): @potiuk
- Bump dompurify from 3.2.2 to 3.2.4 in /providers/fab/src/airflow/providers/fab/www (#46798): @dependabot[bot]
- Bump eslint from 8.57.1 to 9.23.0 in /providers/fab/src/airflow/providers/fab/www (#48143): @dependabot[bot]
- Bump eslint-config-prettier from 8.10.0 to 10.1.1 in /providers/fab/src/airflow/providers/fab/www (#48206): @dependabot[bot]
- Bump serialize-javascript, copy-webpack-plugin and terser-webpack-plugin in /providers/fab/src/airflow/providers/fab/www (#46698): @dependabot[bo
- Bump the fab-ui-package-updates group across 1 directory with 21 updates (#48414): @dependabot[bot]
- Bump various providers in preparation for Airflow 3.0.0b4 (#48013): @kaxil
- Call
initfrom auth managers only once (#47869): @vincbeck - Clean Leftovers of RemovedInAirflow3Warning (#47264): @jscheffl
- Clean up simple auth and fab provider package json files (#47516): @bbovenzi
- Cleanup leftovers from api connexion (#47490): @jscheffl
Linked issues: - Convert exceptions raised in Flask application to fastapi exceptions (#45625): @vincbeck
- Cookies in non TLS mode (#48453): @pierrejeambrun
- Disable Flask-SQLAlchemy modification tracking in FAB provider (#46249): @jedcunningham
- Do not use FAB auth manager methods in views (#47747): @vincbeck
- Do not use core Airflow Flask related resources in FAB provider (#45441): @vincbeck
- Do not use core Airflow Flask related resources in FAB provider (package
api_connexion) (#45473): @vincbeck
Linked issues: - Do not use core Airflow Flask related resources in FAB provider (package
security) (#45471): @vincbeck
Linked issues: - Expose security views in Flask application in FAB provider (#46203): @vincbeck
- FAB login. Fix asset URLs and missing alert (#47586): @vincbeck
Linked issues: - Fix
conf.get_boolean("api", "ssl_cert")(#48465): @vincbeck - Fix
get_menu_itemsin FAB auth manager (#47688): @vincbeck
Linked issues: - Fix
sync-permCLI command (#47626): @vincbeck - Fix FAB static asset (#46727): @jedcunningham
Linked issues: - Fix and simplify
get_permitted_dag_idsin auth manager (#47458): @vincbeck - Fix new UI when running outside of breeze (#46991): @jedcunningham
- Fix section for base_url in FAB auth manager (#47173): @jedcunningham
- Handle user deletion while being logged in in FAB auth manager (#48754): @vincbeck
Linked issues: - Implement
simple_auth_manager_all_adminsin simple auth manager with new auth flow (#47514): @vincbeck - Improve documentation for updating provider dependencies (#47203): @potiuk
- Introduce
filter_authorized_menu_itemsto filter menu items based on permissions (#47681): @vincbeck - Make FAB auth manager login process compatible with Airflow 3 UI (#45765): @vincbeck
- Make parameter
usermandatory for all methods in the auth manager interface (#45986): @vincbeck - Marking fab and common messaging as not ready (#47581): @eladkal
- Move "create db from orm" to be a public method in db manager interface (#48000): @Prab-27
Linked issues: - Move
airflow/api_fastapi/auth/managers/utils/fabto FAB provider (#47571): @vincbeck - Move FAB session table creation to FAB provider (#47969): @jedcunningham
- Move Literal alias into TYPE_CHECKING block (#45345): @uranusjr
- Move airflow sources to airflow-core package (#47798): @potiuk
- Move fab provider to new structure (#46144): @josix
Linked issues: - Move flask-based tests of providers manager to FAB provider tests (#48113): @potiuk
- Move provider_tests to unit folder in provider tests (#46800): @potiuk
- Move tests_common package to devel-common project (#47281): @potiuk
- Moving EmptyOperator to standard provider (#46231): @amoghrajesh
- Prepare fab ad-hoc release December 2024 (#45218): @eladkal
- Re-work JWT Validation and Generation to use public/private key and official claims (#46981): @ashb
Linked issues: - Rebuild FAB assets (#48116): @potiuk
- Remove
airflow.wwwmodule (#47318): @vincbeck - Remove
is_in_fabin FAB auth manager (#47465): @vincbeck - Remove auth backends from core Airflow (#47399): @vincbeck
- Remove links to x/twitter.com (#47801): @ashb
- Remove old provider references and replace "new" with just providers (#46810): @potiuk
- Remove references of "airflow.www" in FAB provider (#46914): @vincbeck
Linked issues: - Remove unused code in Fab provider (#47510): @vincbeck
- Remove unused methods from auth managers (#47316): @vincbeck
- Remove unused webserver configs (#48066): @jedcunningham
- Removed the unused provider's package (#46608): @potiuk
- Rename
get_permitted_dag_idsandfilter_permitted_dag_idstoget_authorized_dag_idsandfilter_authorized_dag_ids(#47640): @vincbeck - Set JWT token to localStorage from cookies (#47432): @gopidesupavan
- Set simple auth manager as default (#47691): @vincbeck
- Simplify tooling by switching completely to uv (#48223): @potiuk
- Stop reserializing DAGs during db migration (#45362): @jedcunningham
Linked issues: - Update FAB auth manager
get_url_loginmethod to handleFlaskandFastapi(#46527): @vincbeck - Update FAB provider documentation (#48247): @vincbeck
- Update create token apis in simple auth manager (#48498): @vincbeck
- Update docstring for users param in auth managers (#47334): @jedcunningham
- Update fast-api generated code after Pydantic upgrade (#48484): @potiuk
- Update simple auth manager documentation to include token API (#48454): @vincbeck
- Upgrade
copy-webpack-pluginto latest version in FAB provider (#48399): @vincbeck
Linked issues: - Upgrade providers flit build requirements to 3.12.0 (#48362): @potiuk
- Upgrade ruff to latest version (#48553): @potiuk
- Upgrade to FAB 4.5.3 (#45874): @potiuk
- Use SimpleAuthManager for standalone (#48036): @jedcunningham
- Use a single http tag to report the server's location to front end, not two (#47572): @ashb
- Use different default algorithms for different werkzeug versions (#46384): @potiuk
- feat(AIP-84): add auth to /ui/backfills (#47657): @Lee-W
- forward port fab 1.5.2 to main branch (#45377): @eladkal
- Move standard, alibaba and common.sql provider to the new structure (#45964): @potiuk
Provider google: 15.0.0rc1
- Streaming option in SFTPToGCSOperator (#48107): @kkulczak
- Remove extra slash character from file URI formation in
MetastoreHivePartitionSensor.pokemethod. (#48731): @Crowiant - Disallowing types-protobuf 5.29.1.20250402 for google to fix mypy (#48666): @amoghrajesh
- Add
tito the RemoteLogIO read and upload methods (#48804): @ashb - Rework remote task log handling for the structlog era. (#48491): @ashb
- Move bases classes to
airflow.sdk.bases(#48487): @kaxil - Move
BaseSensorOperatorto TaskSDK definitions (#48244): @kaxil
Provider microsoft.azure: 12.3.0rc1
- add message_id, reply_to, and message_headers to send message operator (#47522): @perry2of5
- Add
tito the RemoteLogIO read and upload methods (#48804): @ashb - Rework remote task log handling for the structlog era. (#48491): @ashb
- Updated msgraph-core and kiota libraries (#48589): @dabla
Provider microsoft.mssql: 4.2.2rc1
Provider openlineage: 2.1.2rc2
- fix: Adjust OpenLineage DefaultExtractor for RuntimeTaskInstance in Airflow 3 (#47673): @kacpermuda
- Stop trying to reconfigure the ORM in the OpenLineage workers (#47580): @ashb
- fix: Re-add configuring orm for OpenLineage's listener on scheduler (#48049): @kacpermuda
Linked issues: - fix: remove use of get_inlet_defs and get_outlet_defs from OpenLineage (#48792): @kacpermuda
- Make datetime objects in Context as Pendulum objects (#48592): @kaxil
- fix: OpenLineage BaseExtractor's on_failure should call on_complete by default (#48456): @kacpermuda
Linked issues: - Fix OL tests due to decorators move to std provider (#48808): @amoghrajesh
- feat: inject OpenLineage configuration to SparkSubmitOperator (#47508): @mobuchowski
- feat: Add dagrun's end_date and duration to OL facet (#47901): @kacpermuda
- Use TaskInstance ID as FK in TaskReschedule instead of the multiple fields (#47459): @ephraimbuddy
- serialize http transports contained in composite transport (#47444): @mobuchowski
- Implement task-level “on” callbacks in sdk (#48002): @uranusjr
Linked issues: - Calculate retry eligibility before task runs (#47996): @uranusjr
Linked issues: - Implement triggering_asset_events in task sdk (#48650): @uranusjr
Linked issues: - nit: log more details about OpenLineage exceptions being caught (#48459): @kacpermuda
- Add backcompat to openlineage provider method (#48406): @ephraimbuddy
Provider papermill: 3.10.0rc1
- add nbconvert to papermill operator (#48222): @dominic-lcw
- Remove auto lineage from Airflow (#48421): @uranusjr
Linked issues:
Provider postgres: 6.1.2rc1
Provider sftp: 5.1.2rc1
Provider snowflake: 6.2.0rc1
- feat: Send dedicated OpenLineage events for each Snowflake query_id (#47736): @kacpermuda
Linked issues:
Provider standard: 0.3.0rc2
- Make
ExternalTaskSensorwork with Task SDK (#48651): @kaxil - Make datetime objects in Context as Pendulum objects (#48592): @kaxil
- Fix _get_count in sensor_helper.py (#40795): @fuatcakici
Linked issues:- Linked Issue #39616: @nathadfield
- Fix logical_date error in BranchDateTimeOperator and BranchDayOfWeekOperator (#48486): @gopidesupavan
Linked issues: - Move
BaseSensorOperatorto TaskSDK definitions (#48244): @kaxil - Migrate standard decorators to standard provider (#48683): @amoghrajesh
Linked issues:
All users involved in the PRs:
@vargacypher @uranusjr @bugraoz93 @eladkal @guan404ming @ramitkataria @ferruzzi @kacpermuda @vatsrahul1001 @Prab-27 @sunank200 @amoghrajesh @dependabot[bot] @ForeverWintr @dominic-lcw @vikramkoka @panka
Committer
- I acknowledge that I am a maintainer/committer of the Apache Airflow project.
Metadata
Metadata
Assignees
Labels
area:providerskind:metaHigh-level information important to the communityHigh-level information important to the communitytesting statusStatus of testing releasesStatus of testing releases