Other: Extract details in Platform Connector
Answered
Our SAP connector is causing performance issues on our SAP source system. To get a better understanding of what the connector is doing it would be very helpful to have more information about how data is being extracted from the source system. Similar to the new extract_summary message event, but have additional details like how many rows were extracted from each table, size of the data extracted from each table, duration of the extract for each table, success status of each table, and the type of extract for each table (full vs incremental).
Thank you!
Jason
-
Hi Jason, Fivetran will release more detailed insights on the Fivetran Dashboard for running jobs on the table level in the coming weeks. This will provide you per table extracted, processed and loaded rows. I've reached out internally to see if we also put more output to the platform connector as result of this.
As for your performance issues, this is probably best monitored on the SAP system with SM37 and SM50 transactions. If extractions still give challenges then it is best to create a support ticket so engineering can examine what is going on.
Best,
Edwin -
Hi Edwin,
Thanks for the reply! Good to know about the new information coming to the dashboard.
Most of the performance problems are because some of the synced objects are CDS views which requires a full sync. It would be helpful for us to know if a full sync is occurring; hence why I asked for the extract type.
This actually started as a support case, and the suggestion was to identify everything performing a full sync and scheduling those less frequently. That suggestion led to asking if we can identify these tables in the platform connector.
Thanks again!
Jason
Please sign in to leave a comment.
Comments
2 comments