Connector Improvement: Snowflake Connector & other connectors- Schema Change management
Planned- Schema change management - the ability to alert customers of changes to schemas in Snowflake connector when Block All Schema Changes setting is enabled.
We were looking for a feature where we have Block All setting enabled to be compliant with an interface contract with source. But in some cases source may modify the Schema without us knowing especially for the agreed interfaced columns; example datatype changes. We want and ability where Customers are alerted in the scenario of changes upstream , pipelines should be paused & effective restart ability is defined.
With Allow Columns, With Allow All we expect customer to be notified. In the case of changes to existing interfaced columns being changed. Connector needs to Pause, Customer should be notified & effective restart ability is defined.
-
Official comment
Hi Yash,
We’re investigating how to surface this information in our platform logs. .
Regarding changes to the sync mode, this isn’t currently on our roadmap, but we’re always looking for upvotes in the portal to help us prioritize the feature. However, we’re developing a feature to lock data types and prevent unintended changes, which should address part of your request. We will keep you update in this portal
Best regards,
Please sign in to leave a comment.
Comments
1 comment