Connector Improvement: API rate limit issue for Apple connector
Not plannedFeature request:
Regarding API rate imit issue of Apple connector. Rate limits are set for each unique key, so is it possible in Fivetran to use multiple keys for the same connector.
Let's say we have two keys (key1 and key2) with each rate limit set to 100. Is Fivetran able to utilize key2 in case of key1 is running into rate limit issue.
Is this feature supported in Fivetran currently or is there any plan to include it as feature?
Ticket: https://support.fivetran.com/hc/en-us/requests/185222
Fivetran response:
We sincerely appreciate your patience while we check your query with our internal team.
I would like to inform you that we are not currently using the API key to configure the connector. Instead, we use an Apple ID and password with two-factor authentication. Also, I would like to let you know that Apple App Store API limits are applied on the account level only, so creating multiple keys for the same account will still have the same API limits, which will be divided and might not help increase the limit.
However, we suggest you check with the Apple support team to see if using multiple API keys will increase the rate limit for the Apple app store API. If they confirm that, it will increase the rate limits. We recommend that you submit your request through our feature request form for careful consideration and potential implementation in the future.
Please also mention your business use case while raising the same. Once you submit the request, our Product team will review it and update it directly. So please make sure to upvote and follow the request you create, so you get all updates.
Business usecase:
Our prod apple connector(apple_appstore_prod) is running into API rate limit issue when all the tables (66) are selected in the schema. Currently we don't have requirement for all the tables and selected only the required tables(9) from schema but in future we might need all of them. Since we need all the tables in the future and we don't want to run into the same issue again so we are looking for alternate feature request which will mitigate the issue.
-
Official comment
Hi Srinivasa,
We are actually starting to shift our current connector to the new App Store Connect API. That should help with some of the rate limit issues you may be experiencing. Let me know if you would like to test this new connector.
Frank
-
Hi Fivetran Support team,
Can you please share some update if this is feasible?
Thanks,
Srinivasa
Please sign in to leave a comment.
Comments
2 comments