Connector Improvement: Custom Schedules for Feeds with a sync frequency > 24 hours
We are requesting the ability to set a feed to a custom sync frequency to sync at specific times during the day with a sync frequency greater than once a day. For example, we'd like the ability to set a sync start time for a feed that syncs every 6 hours to sync at midnight, 6 am, noon, and 6pm.
-
Seconding this! My team has a large number of connectors, and many of them run 2 or 3 times per day. But Because they all run at the same time (every 8 or 12 hours starting at midnight), we're regularly running into rate limiting issues in our destination when hundreds of connectors all attempt to sync at the same time.
If we could set the `daily_sync_time` property for connectors with sub-daily syncs, we could spread out our syncs more evenly throughout the day and safely increase our volume on Fivetran. As is, if we continue to grow, we're likely going to have to explore alternatives to Fivetran that can handle larger numbers of connectors.
-
Upvote this functionality. Our team also have connectors with 2,3,6 h intervals and and it's not obvious from the beginning (when you create connector) that you want be able to adjust or shift hours when the sync will start. If we want to adjust some connectors to run sync in specific time(less then 24h) we literally need to create a new connector and even more wait for specific time when you need to run initial sync which is a big limitation.
Please sign in to leave a comment.
Comments
2 comments