Connector Improvement: Configure the backwardSyncLimit for historical syncs
Our use case only requires us to sync the last 12 months of data from a connector. However, for some connectors the historical sync pulls in more than 12 months of data. We would like the ability to set the backwardSyncLimit for a connector, so we only sync the data we need.
Would like to be able to set the backwardSyncLimit on a group level and have all connectors within that group inherit it, but have the ability to override it at the connector.
-
I'm not sure if it matters what connector your using, but adding this to the Qualtrics connector would be great!
-
+1 for this feature.
We are also looking for the ability to configure backwardSyncLimit for a connector. We only require past 6 months data. Loading any more data would be unnecessary load on our customer's APIs which could be avoided.
This feature is already supported by most ETL tools, such as Stitchdata, Meltano, and Airbyte etc. We were surprised to find out that Fivetran don't have this feature.
Please sign in to leave a comment.
Comments
2 comments