Connector Improvement: Schedule Option for On-demand Sync Only
AnsweredThe least frequent schedule available is "every 24 hours." I'm looking to have an "on-demand sync" option added.
For many of my Sharepoint folder syncs, I receive the data weekly. My process is:
- MS Power Automate monitors my Fivetran source Sharepoint folders.
- If a folder is updated with new files, PA sends an api command to the connector to kick off a sync.
- PA sends me an email to confirm a successful api command.
I have found this to be a very reliable and easy solution.
Rather than have my connections running daily when I know there won't be any data for them to pick up, I would like to have an option to schedule a connection for "on-demand sync" only.
-
Official comment
Hi Paul,
Thank you for taking the time to share your preferred workflow.
What is slightly confusing me is why you benefit from having any of the MS Power Automate steps at all?
Fivetran is monitoring the Sharepoint folder for you. The Fivetran Platform connector can be used to monitor when a connector completes a sync and how much data has been transferred in that sync.Best regards
Alison
-
Alison, I'm using the Power Automate steps so I can ensure that the sync happens when I need it to for the one time each week I have new data.
The alternative would be to have Fivetran sync every day, seven days a week, every fifteen minutes so I can capture the one sync for the week in a timely manner.
-
Hi Paul,
Right - but why would having Fivetran sync every day, seven days a week, every fifteen minutes be a problem for you?
We only charge for data we actually transfer, we are designed and optimized for that very quick sync check in to see if there is new data ready.Alison
-
Alison, your point is well taken and perhaps my thought process here was a little old-school.
I've gone ahead and changed all of the sharepoint connectors to 15 minute syncs and will be disabling the Power Automate jobs.
On the good side, I learned how to work with the Fivetran API!Thanks for your help.
Please sign in to leave a comment.
Comments
4 comments