SDK Connector: Enable --naming SOURCE argument for SDK Connectors Syncing to a AWS MSK Kafka Destination
Which connector?: Connector SDK
Additional details:
Source Naming is not currently supported for Connector SDK connections using a Kafka destination. When trying to create a connection the following error was returned when specifying the following argument: --naming SOURCE:
SOURCE_NAMING option for 'destination_schema_names' is not supported for connector 'connector_sdk' and destination 'Kafka'
This is causing issues downstream where Fivetran naming convention is applied causing table names to be changed. Tables named my1table at source is being renamed to my_1_table in my destination causing issues to downstream processes, data integrity, and data unification efforts.
-
Also wanted to add that the renaming is applied to tables and columns.
-
Hi Ryan,
Thanks for submitting this request! Our team is currently evaluating it, and I'll share an update in this thread as soon as we have more to report.
Best,
Please sign in to leave a comment.
Comments
2 comments