Connector Improvement: Connect then introspect
Skyvia is an example of an ETL service that will allow you to connect but then introspect the raw data using SQL queries before you ever pipe to your lake/warehouse.
Docs: https://docs.skyvia.com/query/
Could Fivetran do something like this?
-
Hi Josh,
I'm not sure I understand the benefit here. You could run partial queries in your destination warehouse/data lake during the historical sync (i.e. after Fivetran has delivered the first batch of data), but they won't necessarily give you correct results before the sync completes.
-
Hi Eric,
I agree with you. Having used FT for a year since posting this comment, I can see how pre-inspection of the data is not really needed.
Josh
-
Hi Josh,
Ok, sorry it took so long to get back to you, but I'm glad this is no longer an issue.
Eric
Please sign in to leave a comment.
Comments
3 comments