Other: Allow triggering a full historical sync for a connector through the API
Completed
Currently the UI offers a button to do a full historical sync for an entire connector. There is no matching API endpoint. It would be very helpful to be able to trigger this through the API .
-
Official comment
Hi Ryan,
Thanks for writing in! This is something we're considering as part of making our API feature complete with our UI. Can you describe the specific use case that you're looking to automate as part of this?
Thank you!
Jimmy
-
Hey--I also have needed this. In particular, the google storage connector does not support the table refreshes API, so I have no work around. The UI for navigating between many connectors setup with the google storage (which is by defacto one table per connector) is quite challenging and time consuming if you need to reset a number of connectors.
-
Specifically when I try the table refresh API on the Google Storage connector I get this error:
{'code': 'InvalidInput', 'message': "Integration doesn't support table re-sync"} -
Hey Ben Liyanage and Ryan Fahsel, this is possible!
https://fivetran.com/docs/rest-api/connectors#resyncconnectordatahistoricalsync
Calling this endpoint without a payload will trigger a full historic sync:
https://api.fivetran.com/v1/connectors/{connector_id}/resyncYou can also call the modify a connector endpoint:
https://fivetran.com/docs/rest-api/connectors#modifyaconnectorIf you send a modify request with
is_historical_synctoTRUE, the next scheduled sync will be historical, all subsequent ones will be incremental. This parameter is set toFALSEonce the historical sync is completed.
Please sign in to leave a comment.
Comments
4 comments