Record Count Validation & Primary Key Reconciliation
AnsweredWe’d like Fivetran to provide built-in data validation to ensure completeness between source and destination.
-
Record Count Validation: Automatically verify that source and destination record counts match on a recurring basis, with alerts for discrepancies.
-
Primary Key Reconciliation: Periodically compare primary keys between source and destination to identify missing or duplicate records.
This would improve trust in data pipelines and reduce the need for custom validation solutions.
-
Official comment
Hi Venkat,
I'm Ryan, one of the PMs at Fivetran focusing on data validation. Really appreciate your feedback. We're looking into this and I will provide an update when I have one.
Best,
Ryan Waldorf
Please sign in to leave a comment.
Comments
1 comment