Pydantic improvements

[sultaniman]

This PR is to address the issue #895 which is when pydantic column schema is provided.
Adjustment recursively calls pydantic_to_table_schema_columns to expand for sub model.

[netlify]

✅ Deploy Preview for dlt-hub-docs canceled.

Name	Link
🔨 Latest commit	bac3fac
🔍 Latest deploy log	https://app.netlify.com/sites/dlt-hub-docs/deploys/65c3996cccafaa00098f9459

[codingcyclist]

Great stuff - I think the behavior between pydantic and other complex constructs is not 100% consistent yet in cases where skip_complex_types = False. I left some comments

[codingcyclist]

Hooray, great stuff 🙌

[rudolfix]

IMO we have an edge case when there's pydantic model defined and we have skip_complex_types set to true. please see my review

[rudolfix]

@sultaniman this looks good now. and I know where the problems with duckdb come from. we have a special area in tests suite for local pipeline tests

tests/pipeline/test_pipeline_extra

you can move your tests there, our workflow will make sure that duckdb and pydantic are installed

[rudolfix]

logic LGTM!
@sultaniman this code asks for unit tests. we have unit tests for the mapper in libs. why you didn't add the tests there? please test all combinations explictly

[sultaniman]

logic LGTM! @sultaniman this code asks for unit tests. we have unit tests for the mapper in libs. why you didn't add the tests there? please test all combinations explictly

@rudolfix do you mean to add tests for TypeMapper in destinations libs/test_pydantic?

[rudolfix]

LGTM! thanks for all the tests!