Other: Sync possibilities
AnsweredI'd like to know if it's possible to define the following in sync frequency:
- Sync to run weekly or biweekly (as in the UI the less frequent option is 24 hours).
- To run connectors every 6 hours but only in particular days (for example, not running on Saturday or Sunday).
If that's not possible though the UI, is it possible to run sync from an API? If possible, we could disable connector from running automatically and call it on demand from API.
If any of the latter is possible, do you have any other suggestions?
Thanks,
Gabriel.
-
Official comment
Hi Gabriel,
I'd love to learn more about why you would like these sync frequencies.
What is your reason for not wanting the data to sync every 6 hours but not on the weekend? Same questions, but I assume there's a different reason for wanting to sync only weekly or bi-weekly?
This is not possible in the UI today, but other folks can up-vote this and we may enable it in the future. The good news is you can create custom frequencies using the API (and disable it from running on it's own schedule). This support article shows you how to set this up.
-
Hi Andrew,
I tried the Fivetran REST API to update the sync frequency but its still not letting me choose any value higher than 24 hours. I want to setup my sync weekly so tried with value 10080 and got the following error:
{"code": "InvalidInput","message": "Unsupported sync frequency. Supported values: 5 | 15 | 30 | 60 | 120 | 180 | 360 | 480 | 720 | 1440"}is there any other way for setting the frequency to a higher value?Thanks,Abha -
Hi Abha,
It's currently not possible to set sync frequencies outside of our pre-defined values, regardless of if you do it via the UI or API.
However, if you want to use your own external orchestrator, you can set syncing to manual, and then run sync's when you want to. Here's a guide on how to do this: https://fivetran.com/docs/rest-api/connectors/connector-management-api-faq/trigger-syncs-manually
Jimmy
-
Thanks for the alternate solution Jimmy.
In the step to make schedule type as manual do we have to add:"run_setup_tests": false
can't this be skipped?
-
Hi Jimmy,
I set the schedule type to manual via API and the sync frequency is shown as follows:
The response still showed sync frequency as:"sync_frequency": 1440,"schedule_type": "manual"
Also, the sync was still triggered at the regular time even after changing schedule type to manual.
Please let me know if I am missing anything.Thanks,Abha -
Hey Abha,
If you don't specify run_setup_tests as false, it will run through them. You should only need to run setup tests if you're making more significant changes that would adjust configuration, not just scheduling.In regards to the sync_frequency, that should be fine as long as the schedule_type is manual. Can you raise a ticket with support re: the connector still running without you initiating a sync?
Jimmy
-
Hi Fivetran team, seems this is still in the wishing list after 3 years? Can you please prioritize this? We have similar requirements to set custom schedule for our jobs. Can we simply support cron jobs (if not UI, at least from API)? If we can enable UI feature to have more flexible schedule, that will be even better.
Please sign in to leave a comment.
Comments
7 comments