SDK Connector: Enable --naming SOURCE argument for SDK Connectors Syncing to a AWS MSK Kafka Destination
Which connector?: Connector SDK
Additional details:
Source Naming is not currently supported for Connector SDK connections using a Kafka destination. When trying to create a connection the following error was returned when specifying the following argument: --naming SOURCE:
SOURCE_NAMING option for 'destination_schema_names' is not supported for connector 'connector_sdk' and destination 'Kafka'
This is causing issues downstream where Fivetran naming convention is applied causing table names to be changed. Tables named my1table at source is being renamed to my_1_table in my destination causing issues to downstream processes, data integrity, and data unification efforts.
-
Also wanted to add that the renaming is applied to tables and columns.
Please sign in to leave a comment.
Comments
1 comment