Order of Fields in the Stream is not being preserved

[vamsikurre]

Topic

Connection creation bug

Relevant information

I have created a custom source connector for Oracle Database to preserve the order of the stream fields in the catalog,

I have created a table with the below structure

CREATE TABLE ASAMPLE_TABLE ( "ZSAMPLE_COLUMN" TIMESTAMP (6), "SAMPLE_COLUMN1" VARCHAR2 (1000), "1SAMPLE_COLUMN" VARCHAR2 (1000) );

I managed to preserve the order in the connector's discover call and the output of the discover call is as below

{"type":"CATALOG","catalog":{"streams":[{"name":"ASAMPLE_TABLE","json_schema":{"type":"object","properties":{"ZSAMPLE_COLUMN":{"$ref":"WellKnownTypes.json#/definitions/TimestampWithoutTimezone"},"SAMPLE_COLUMN1":{"type":"string"},"1SAMPLE_COLUMN":{"type":"string"}}},"supported_sync_modes":["full_refresh","incremental"],"default_cursor_field":[],"source_defined_primary_key":[],"namespace":"DJOSOURCE"}]}}

But in the UI the column order is not being preserved

As a result of this, the table structure at the destination is being created with the wrong column order
2024-12-06 11:06:31 destination > INFO type-and-dedupe i.a.c.d.j.JdbcDatabase(executeWithinTransaction$lambda$1):46 executing query within transaction: create table "airbyte_schema"."test_asample_table" ("1sample_column" varchar(65535), "sample_column1" varchar(65535), "zsample_column" timestamp, "_airbyte_raw_id" varchar(36) not null, "_airbyte_extracted_at" timestamp with time zone not null, "_airbyte_meta" super not null);

Log of the sample job
default_workspace_job_15_attempt_1_txt.txt