Connector Improvement: SFDC (but not only) Data Integrity Warnings
Not plannedThere are cases where SFDC connector will claim that sync is fine, where actually there are data integrity issues (as per support request 54420). For example, if some objects that are supporting soft deleting in SFDC acutely going to be hard deleted, or there will be some issues with not enough space in trash. Fivetran is not providing any kind of basic checks or warnings for such situations. Source vs Fievtran sync table in such cases can be totally different. Currently there is no other way to monitor it, only via custom code created outside of Fievetran.
-
Official comment
Hi Tymoteusz,
Thanks for this request. Some kind of check to verify the data integrity across source and destination would be a great feature. We have been evaluating this for some time, but it's not quite something we're looking to do any time soon.
There could be a number of different ways to implement something like this. Some of which would involve Fivetran reading from your destination database/warehouse. Is that something that your team would find acceptable for the purposes of data validation?
Please sign in to leave a comment.
Comments
1 comment