Other: REST API: Connector details should include last sync_stats
AnsweredWhen we consume the Connector Details API it should include the last sync_stats info as it appears on the logs:
"sync_stats" : {
"process_time_s": 12,
"process_volume_mb": 0,
"total_time_s": 44,
"load_time_s": 13,
"extract_time_s": 12,
"load_volume_mb": 0,
"extract_volume_mb": 0
}
-
Official comment
Hey Cesar Oliart, sounds like an interesting feature addition! Could you elaborate on how you'd use sync stats? What are you trying to solve for?
Thanks!
-
Hey Jimmy, we are using the REST API to sync some connectors but we need need more details when the last sync was ran for example as it is the REST API for the connector details retrieve only the date-time when the last sync run successfully but it doesn't give the detail of how many time it takes on record new data or if was any new data recorded on the destination, or the total time elapsed on the syncing process
We want this information in order to have a better picture on how our warehouses are working and do some improvements.
Thanks
-
Cesar Oliart We're also exploring webhooks right now, and I wonder whether or not having this data both within the connector details and within webhooks would be helpful to you.
When you say you want a better picture of how your warehouses are doing and making improvements, could you dig in a bit more? Would love to have a better picture of how we could provide just-in-time information for your workflows.
Please sign in to leave a comment.
Comments
3 comments