New Connector: I Need Assistance with the Synchronisation and Transformation of the Fivetran system Data
AnsweredHello everyone
I hope everyone is doing well. I am reaching out to you to ask for help with some difficulties I am having with synchronisation and transforming data with fivetran. After using fivetran for a few months; I am largely happy with its features and performance.
- The synchronisation of data between our source databases and our destination warehouses is sometimes lagging; as I am finding out. Sometimes these delays prevent accurate data updates; which is critical to our reporting and analysis. I have already verified that there are no problems with connectivity on our end by checking our network connections. Has anyone else experienced similar delays in synchronisation? Which setups and troubleshooting techniques would you suggest to reduce these delays and ensure real time data updates?
- The synchronisation of data between our source database and our destination warehouse is sometimes lagging, as I am finding out. Sometimes these delays prevent accurate data updates; which is critical to our reporting and analysis. I have already verified that there are no problems with connectivity on our end by verifying our network connections. Has anyone else experienced similar delays in synchronization? Which setups and methods for troubleshooting would you suggest to reduce these delays and ensure real time data updates?
- Managing changes to the source databases schema is one of the constant issues we encounter. The disruptions in our data pipelines may occur from changes made to the structure; such as the addition of new columns and modifications to the data types. How may schema changes in the fivetran system be handled most effectively? Can schema changes be detected and managed without affecting the data process using automated processes and tools?
- The integrity of the data pipeline depends on efficient error logging and management. While The fivetran has some built in monitoring skills; I am searching for better performing options that work with the infrastructure we already have in place for monitoring. How can you keep an eye out for mistakes and performance problems in your fivetran system data waterways? Do you have suggestions for any integrations from third parties and technologies for improved monitoring and alerting?
- To successfully control costs; we are trying to maximise our use of the fivetran system. While I understand that data volume and syncing frequency can have an effect on prices; I am curious about any further strategies and setups that could lower our overall spending. In order to balance cost and performance; how should your fivetran system improve? We would really welcome suggestions and recommendations in this field.
Also I explored some topics related to this https://support.fivetran.com/hc/en-us/community/posts/1500001285902-New-Connector-Amazon-Vendor-Looker-Central-and-Seller-Central-Connectors but I did not get the sufficient solution of my query so I would really want to get some help from a more experienced person
I would be appreciative of any knowledge; personal accounts; and resources that the community may provide. I appreciate your support and assistance in advance.
Thanks in advance for your support
-
Official comment
Hi Natasha,
This is best handled by our Support team. If you’re still experiencing issues, please don’t hesitate to open a support ticket so we can assist you directly.
Best,
Please sign in to leave a comment.
Comments
1 comment