Connector Improvement: Qualtrics
Not plannedFor Qualtrics connector, we need the ability to de-select tables such as batch_transaction_membership and contact_transaction. These unnecessary syncs are both costly and inefficient. Just to give you an example, it's costing us 3.5 million rows per month from these tables that we don't need. They also significantly increase the average sync time to over 3 hours each run.
-
Official comment
Hi Andy - we carefully consider all requests to add configuration to Fivetran connectors. Additional configuration comes at the real cost of increased code complexity and increased maintenance effort. That results in fewer new connectors and features. Configuration for one or two tables doesn't sound like much, but each request is for different tables. Implementing each one would create an impossible burden across the thousands of tables in our carefully designed schemas. Where we have added table configuration to API-based connectors is when the MAR is disproportional to the MAR of the entire connector. I understand that in your use case, these tables may contribute significantly more MAR than others, however across our customer base, these two tables appear to represent around 6-7% of Qualtrics MAR on average, so unfortunately we will not be considering adding table selection for these tables at this time.
We will continue to monitor for demand for this request and reevaluate accordingly.
Please sign in to leave a comment.
Comments
1 comment