Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Github connector stops active syncing when new schemas are added and is slow

Answered
Kavin Kumar P User

Which connector?:

Github connector

Additional details:

We have around 2k repos in our organization and given how Github connector works we are not able to build consistenly and incrementally with the data it produces. 

  1. New schemas when added for sync initiate a full historical sync takes >10days and existing schema data goes stale during this time. 
  2. GH connector is only able to 1million data on average which is very low and is the root cause of (1). Moving to a different approach rather than APIs is a better alternative. 

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Frank Fivetranner

    Hi Kavin,

    Thanks for sending this. We are exploring ways to have the historical sync not block the incremental sync across Fivetran and will update this thread when there is more updates.

    Thanks,
    Frank