Other: Add a dedicated Terraform resource (or attribute) for updating schema_change_handling without requiring the full schema
AnsweredWe’d like a simple way in Terraform to change the schema sync policy (schema_change_handling, e.g., switch from ALLOW_ALL to ALLOW_COLUMNS) for a connector without having to specify every table and column. The REST API already allows us to do this with a single PATCH call, but the existing fivetran_connector_schema_config resource requires us to maintain the full schema, which is unmanageable across more than 50 connectors and often causes apply errors when new tables are added. Please add either a small standalone Terraform resource or a simple attribute on the existing connector resource that enables us to update only the policy, leaving the rest of the schema unchanged. This would keep our infrastructure-as-code neat, prevent unnecessary backfills when Stripe or other sources add new tables, and save us considerable operational time.
Every time a new Stripe table is added, long backfills delay our data processing and breach data-freshness SLAs, so we urgently need this fix to prevent costly delays.
Proposed feature
resource "fivetran_connector_schema_policy" "this" {
connector_id = fivetran_connector.stripe_us.id
schema_change_handling = "ALLOW_COLUMNS"
}
-
Official comment
Hi Dhiva,
This is a pretty reasonable request, I appreciate you going into so much detail about your pain points and the proposed implementation. I'll work with the engineering team to prioritize this.
Thanks,
Jimmy
Please sign in to leave a comment.
Comments
1 comment