Introduction
In this article, find out how to ensure you have enough Marketo API resources available to allow for a timely initial/historical sync and successful incremental syncs.
Environment
Connector: Marketo (created after November 2019)
Recommendation
Fivetran recommends customers purchase sufficient Bulk API quota from Marketo to allow our connector to sync successfully in a reasonable time. The majority of data from Marketo is generated from fetching activity data, so Fivetran’s latest version strictly uses the Bulk API to extract all activity data as efficiently as possible.
When Fivetran connectors exceed your Marketo Bulk API quota, the connector is automatically rescheduled in order to wait for the quota to be reset that night. See our Marketo Sync Overview for more details.
Marketo customers have a default Bulk API quota of 500MB per day. Marketo allows customers to purchase a higher daily extract limit by choosing one of the following:
- Bulk Extract Additional 1GB
- Bulk Extract Additional 3GB
- Bulk Extract Additional 5GB
- Bulk Extract Additional 10GB
Fivetran generally recommends customers start with a 5GB increase in order to get through the historical sync.
From there, monitor your incremental Bulk API usage with Marketo and decrease to 3GB or 1GB if that is all that is needed. Fivetran tests show that customers very rarely require an additional 10GB. See Marketo's Bulk API and REST API Limits or reach out to your Marketo Customer Success Manager for more details.
Considerations
Fivetran rarely runs into REST API quota limits, so we do not suggest increasing this unless you are receiving Fivetran errors explicitly about the REST API quota. For more information on this see Marketo's REST API documentation .
Bulk export usage needs to be calculated by adding up the file size of the completed jobs; there is no separate call for this like for the REST API.