Connector Improvement: CM360 - Enable Filtering Or Limiting Of Data To Improve Reliability
We are currently syncing a significant report of 100GB daily of all activities from CM360. This sync frequently breaks due to ephemeral connection (`Error: Connection Reset` is the most popular). These types of issues provide little recourse for us. We want to limit the volume of data coming through the report and ultimately improve the reliability of the connector.
A few ideas our team has floated include...
- [Preferred Solution] Bring in entire reports from Google Campaign Manager 360 (CM360) rather than defining the metrics and dimensions within Fivetran. This will allow us to make the reports in CM360, define the metrics, dimensions, and filters, and then bring data through Fivetran as a report rather than individual fields. This process is the current setup for Google Display and Video 360 (DV360) in Fivetran, a similar platform. This feature would solve our Activity Filter issue since the activity filter already exists in CM360 reports and would also save ~1 hour of metric and dimension entry each time since the current process involves defining these fields on both the CM360 and Fivetran side.
- [Acceptable Solution] Enable activity filters within Fivetran. This solution would help us filter down the activities and break these data pulls into multiple connectors, limiting the amount that needs to be pulled at once and speeding up the process as well as limiting the risk for breakage.
---
- Activities refer to different onsite events such as add to cart, page view, or purchase. We want to be able to tell Fivetran to only bring in purchases or add-to-cart activities so that we don't have to bring in all of these every time we do a sync.
-
Official comment
Hi Brandon, Drew from the Product Team here!
Thanks for the feedback and the example related to DV360. It sounds like a similar solution to what is provided there would solve your problem. It looks like CM360 also provides a report list endpoint: https://developers.google.com/doubleclick-advertisers/rest#rest-resource:-v4.reports
I'll have engineering take a look at these endpoints and see if it is possible to replicate this functionality for CM360.
Please sign in to leave a comment.
Comments
1 comment