Connector Improvement: Sync only first 100 rows
When initially establishing a connector, it would be very helpful to be able to sync only the first X rows (20 rows or 100 rows). This will be beneficial in two ways:
1. Increase the speed of an initial connection sync, so that we can sample data in the warehouse shortly after establishing the connector.
2. Allow for screening of sensitive data prior to performing a full historic sync. In a column should be hashed, or not synced entirely, this allows auditing of the data prior to landing a lot of potentially sensitive information in the warehouse.
-
Hi Erin,
This is a valuable idea and has been added to our feature improvements backlog. I am interested in learning more about your use case. Could you share which connectors or data sources this would be most useful for, and if there are specific challenges you've encountered during initial syncs? Understanding your process around data sampling or sensitivity screening will help us refine potential solutions.
Updates on progress will be shared on this thread to keep the community informed.
Thanks,
Dennis
Please sign in to leave a comment.
Comments
1 comment