Connector Improvement: Speed up Pendo event syncs
Completed
The current Pendo connector takes > 1 month to perform a sync of only 16GB of events.
This is a massive issue, considering any time a new event is tagged, a full re-sync needs to be performed (unless this feature request is fulfilled), and the re-sync will take > 1 month as well.
It really isn't that hard. I have personally backfilled the complete feature_events table using python in less that 4 hours because of asynchronous request libraries. I expect Fivetran to take an acceptable amount of time to backfill any table. >1 month is not acceptable.
-
Official comment
Hi Ian Pearthree, Drew from the Product Team here!
Thanks for this feedback and sharing. We are looking at strategies to improve the performance of this connector, so please stay tuned for updates on this.
-
Just wanted to drop an update here. We recently rolled out multithreading for the Pendo connector which has led to significant performance improvements related to the historical sync.
Please sign in to leave a comment.
Comments
2 comments