Connector Improvement: Throttle Marketo API Calls
AnsweredMarketo has a limit of 100 API calls per 20 seconds. Fivetran frequently meets or exceeds that limit. While it isn't an issue for Fivetran, it is an issue for anything else using the Marketo api. This causes errors for other applications.
I would like a way to throttle the number of api calls Fivetran makes in a 20 second period so there is breathing room for other applications.
-
Official comment
Hi Jason,
Fivetran currently supports configuring the number of Marketo API requests allocated per connector using our REST API. You can find details and sample usage in our documentation here: Marketo API Quota Configuration. This feature enables you to manage your quota and prevent excessive API usage. If your use case requires different or additional throttling options, can you share why this doesn't work for you?
Thanks,
Shiva -
Thank you for the response but the current quota limit is "Allowed number of API requests to Marketo instance per day". We need the ability to limit the number of calls per 20 seconds.
Overall, we are ok with the total number of calls per day. When Fivetran runs, it executes so many API calls at once that it prevents anything else from using Marketo for a short period of time. We need a way to limit Fivetran to making 50 api calls per 20 seconds for example.
Thanks again!
Jason
-
Hey Jason,
Thanks for submitting this and following up. I'm the Product Manager for our Marketo connector.I think I understand your use case for wanting to limit the calls per 20 seconds. I get why the current parameter doesn't address that.
I'd love to discuss this further with you. I want to find a solution that addresses your use case without adding complexity to the connector for other users. I'll reach out via email to book a call.
Cheers,
Luke -
I am experiencing similar issue with Marketo/Fivetran integration as described, it results in generating Warning ("606 ") : The number of calls in the past 20 seconds was greater than 100 exceeded with in `%s` secs, and we only able to see this issue on Marketo logs: FIvetran does not display or alert us on this warning
Would be great if we had a control over call rate configuration and fivetran provided an option on UI to make an adjustment, and also to provide a Fivetran user with visibility of warningsThank you , Svetlana Magdel
Please sign in to leave a comment.
Comments
4 comments