Skip to main content

Community

Connector Improvement: GA4 Export Connector Control of the Incremental Sync Window

Answered

Please sign in to leave a comment.

Comments

1 comment

  • Official comment

    Hi Cindy,

    Thanks for submitting this request.

    Our current rollback sync strategy is based on this note in Google's documentation:

    Daily export tables (events_YYYYMMDD) are created after Analytics collects all of the events for the day. Analytics will update daily tables for up to 2 calendar days, plus today beyond the date of the table with events that are timestamped with the date of the table, such as event bundles that come in late from Measurement Protocol or the Firebase SDKs. For example, if the table date is 20220101, then Analytics will update the table through 20220104 with events that are timestamped 20220101.

    However, we understand that Google can also reprocess records outside of this 3-day window. Is that why you're requesting a configurable window?

    My concern is that the incremental sync for this connector can already be slow, given the volume of data. Users may not understand the implications of increasing the rollback window and may unintentionally impact sync speed. If Google cannot tell users how long it may take to finish processing records, then a Fivetran user doesn't know how long to set their rollback window. Asking them to choose something arbitrary like this makes the setup and use of the connector more challenging.

    In your case, do you have some way of knowing how long the connector needs to look back?

    Thanks for your input on this,
    Luke