Here are two necessary improvements that ServiceNow support made while using the fivetran ServiceNow connector during a full initial load from our ServiceNow test instance:

1. Reduce the amount of records being queried per page, they found that fivetran is pulling 10000 records at a time for some tables and 5000 for others. They suggested to decrease the page size, in order to reduce the time servicenow threads are taking to fulfill each query. this could be implemented by creating a max record setting that the connector will use while querying servicenow tables. you are already dealing with pagination to bring data across from the source instance, adjusting the max page size should be straight forward.

2. Space out queries. They also observed that fivetran is overwhelming the API threads by sending too many queries without pause. This has the potential to impact other integrations that are also doing API queries. They recommended to add a pause (30 seconds or so) between queries. you can also implement this enhancement by adding a wait setting that your connector can use between queries. this is also a very simple change.