Github connector stops active syncing when new schemas are added and is slow
Which connector?:
Github connector
Additional details:
We have around 2k repos in our organization and given how Github connector works we are not able to build consistenly and incrementally with the data it produces.
- New schemas when added for sync initiate a full historical sync takes >10days and existing schema data goes stale during this time.
- GH connector is only able to 1million data on average which is very low and is the root cause of (1). Moving to a different approach rather than APIs is a better alternative.
Please sign in to leave a comment.
Comments
0 comments