Connector Improvement: Sync Empty Tables and Columns
Not plannedWe'd like to see all connectors support syncing empty tables and columns
https://fivetran.com/docs/using-fivetran/features#syncingemptytablesandcolumns
See Support Case 296484 for additional background
We utilize fivetran to onboard retailers utilizing multiple point of sales systems onto our analytics platform. So, we may have 20 or so retailers utilizing Connector X pulling into 20 different databases, 5 utilizing Connector Y pulling into 5 other databases (with different schemas as they're different systems). Repeat for Connector A, B, C, and D.
We pull data from those disparate databases into a consolidated data store that we then run analytics on.
Queries against one system will be different than queries on another system but the expectation is that data access for one system regardless of which retailer database we're accessing is all the same.
We recently discovered that that is not the case and that columns that contain all null values are not created in the destination database despite that column being selected in the schema of the connector.
The end result is data access queries written for one system might work for one retailer but might not work for another.
We need consistency between schemas created for a given connector type or we end up with data access queries that break and prevent us from consolidating data for consolidated analytics.
Ideally there would be consistency between all connectors available within Fivetran but if you need specific connector types for prioritization we're asking for Heartland Retail POS, Lightspeed R POS, and Shopify in that order.
Thanks!
-
Official comment
Hi John,
Thank you for taking the time to share this feature request. We appreciate your feedback and agree that this is a valuable idea that could help improve how you setup your workflows.
I've added this suggestion to our feature improvements backlog. I don't have an ETA on when we'll be able to pick this up, however, we'll watch to see if there more demand/interest from other interested in having empty tables/columns be added to the destination schemas in our application connectors.
We’ll make sure to keep this thread updated with any progress or news related to this request.
Best,
Shiva Mogili
Please sign in to leave a comment.
Comments
1 comment