handle ClientError raised after key is missing during DyanmoDB table.get_item

[Lee-W]

Why

Since moto 5.0.15, it validates whether the key exists which might indicate we does not check whether the key exist in our sensor.

What

Add an additional check to handle boto ClientError

---

^ Add meaningful description above
Read the Pull Request Guidelines for more information.
In case of fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
In case of a new dependency, check compliance with the ASF 3rd Party License Policy.
In case of backwards incompatible changes please leave a note in a newsfragment file, named {pr_number}.significant.rst or {issue_number}.significant.rst, in newsfragments.

[eladkal]

We are having some canary build failure around dynamo db:

FAILED tests/providers/amazon/aws/sensors/test_dynamodb.py::TestDynamoDBValueSensor::test_sensor_with_pk - botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the GetItem operation: The provided key element does not match the schema
4441
FAILED tests/providers/amazon/aws/sensors/test_dynamodb.py::TestDynamoDBMultipleValuesSensor::test_sensor_with_pk - botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the GetItem operation: The provided key element does not match the schema

https://github.com/apache/airflow/actions/runs/10989610037/job/30508381216#step:7:4458

Looks like botocore changed the dynamodb endpoints boto/botocore#3263 (comment)

Added canary and upgrade labels to rerun the CI with the updated versions

[ferruzzi]

Change looks reasonable.

[vincbeck]

Could you add/update unit test to cover this new branch?

[eladkal]

We are having some canary build failure around dynamo db:

FAILED tests/providers/amazon/aws/sensors/test_dynamodb.py::TestDynamoDBValueSensor::test_sensor_with_pk - botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the GetItem operation: The provided key element does not match the schema
4441
FAILED tests/providers/amazon/aws/sensors/test_dynamodb.py::TestDynamoDBMultipleValuesSensor::test_sensor_with_pk - botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the GetItem operation: The provided key element does not match the schema

https://github.com/apache/airflow/actions/runs/10989610037/job/30508381216#step:7:4458

Looks like botocore changed the dynamodb endpoints boto/botocore#3263 (comment)

Added canary and upgrade labels to rerun the CI with the updated versions

Fixed in #42419

[Lee-W]

Could you add/update unit test to cover this new branch?

Sure! just added

[Lee-W]

We are having some canary build failure around dynamo db:

FAILED tests/providers/amazon/aws/sensors/test_dynamodb.py::TestDynamoDBValueSensor::test_sensor_with_pk - botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the GetItem operation: The provided key element does not match the schema
4441
FAILED tests/providers/amazon/aws/sensors/test_dynamodb.py::TestDynamoDBMultipleValuesSensor::test_sensor_with_pk - botocore.exceptions.ClientError: An error occurred (ValidationException) when calling the GetItem operation: The provided key element does not match the schema

https://github.com/apache/airflow/actions/runs/10989610037/job/30508381216#step:7:4458
Looks like botocore changed the dynamodb endpoints boto/botocore#3263 (comment)
Added canary and upgrade labels to rerun the CI with the updated versions

Fixed in #42419

Thanks! This one was originally meant to solve that, but seems to be the wrong fix 🤦‍♂️