Delta Table & Delta Lake Support

[mavam]

This roadmap item is about Delta Table support.

Definition of Done

Preview Give feedback

1. Investigate options to convert Parquet files to Delta Tables
2. Implement a delta_table printer that writes Delta Tables
3. Figure out how to "commit" Delta Tables to Delta Lake and identify a pipeline-native way to do so reliably

Regarding the last deliverable: as we get to know the API of Delta Lake, we should figure out whether our connector-format API is sufficient here. For example, it would be nice if we could write to delta-lake write delta-table, or even to delta-lake write parquet (since we already have Parquet).

[mavam]

I got this in a DM:

Delta lake support is a magic keyword for us as that's one of the main reason we went with Databricks