Connector Improvement: Fivetran Log: Provide an event group ID
Where there are multiple events that are part of the same 'group' of events, there is currently no explicit way to infer this link.
As an example, regular syncs - these should have a start time, an end time, and a status.
In the above example, using data from the `log` table, there is no way to link the 3 events. I can tell that the 'status' message_event is telling me that the sync that completed at the 'sync_end' time was successful for a single sync, though I can't programmatically group these for multiple connectors over time.
Therefore, it would be great if there was an additional field which contained a sort of 'group' ID for events. Or even if you could include this in the 'message_data' column - this could then be extracted from the JSON.
-
Hi Fabio - do you mean a field like `sync_run_id` to tell they are part of the same sync process?
Fraser -
Yes, for the above example, a `sync_run_id` field would do the trick.
Does this field already exist in the `fivetran_log` tables?
Please sign in to leave a comment.
Comments
2 comments