Connector Improvement: GA4 Export Connector Control of the Incremental Sync Window
AnsweredPlease improve the connector by providing the ability to manually control the incremental sync window of the GA4 Export connector so we can capture late arriving GA4 data.
-
Official comment
Hi Cindy,
Thanks for submitting this request.
Our current rollback sync strategy is based on this note in Google's documentation:
Daily export tables (events_YYYYMMDD) are created after Analytics collects all of the events for the day. Analytics will update daily tables for up to 2 calendar days, plus today beyond the date of the table with events that are timestamped with the date of the table, such as event bundles that come in late from Measurement Protocol or the Firebase SDKs. For example, if the table date is 20220101, then Analytics will update the table through 20220104 with events that are timestamped 20220101.
However, we understand that Google can also reprocess records outside of this 3-day window. Is that why you're requesting a configurable window?
My concern is that the incremental sync for this connector can already be slow, given the volume of data. Users may not understand the implications of increasing the rollback window and may unintentionally impact sync speed. If Google cannot tell users how long it may take to finish processing records, then a Fivetran user doesn't know how long to set their rollback window. Asking them to choose something arbitrary like this makes the setup and use of the connector more challenging.
In your case, do you have some way of knowing how long the connector needs to look back?
Thanks for your input on this,
Luke
Please sign in to leave a comment.
Comments
1 comment