Other: Datadog integration
AnsweredI need Fivetran to be able to tell me how my transforms are doing in Datadog so that I can set up alerts and monitors when things are broken.
Emails and dashboard alerts aren't good enough. It would be helpful to know how long transforms are taking over time as well, how many rows are being transferred, etc.
-
Official comment
Hi Brent,
Thank you for raising this request.To better understand the situation and evaluate the feasibility, could you please help us by briefly sharing:
-
The use case driving this need
-
The issues or gaps you are currently facing that led to this request
-
What additional details or capabilities would you like beyond what you’ve mentioned
-
Whether you see this primarily as a platform ask (observability/monitoring) or a connector/transformation-specific ask
Your input will help us assess the request more effectively.
Thank you. -
-
-
The use case driving this need
Sometimes, Fivetran transformations fail. The only way to know if a failure has happened is by monitoring my email inbox. I would prefer getting more rich statistics (on successes, failures, transform duration, etc.) collected in Datadog or other stats-d compliant services. My own company, Knock, offers metrics like this to our customers. When things happen in Fivetran, it would be great to know about it in our central monitoring infrastructure.
-
The issues or gaps you are currently facing that led to this request
When Fivetran succeeds, I receive no notice about it (though this is somewhat expected, I wouldn't necessarily want an email per successful transform, but there are opportunities to report metrics or traces to customers so they have more opportunities to monitor and tune workloads.
Today, the closest thing to this is manually paging through the web UI or monitoring for emails on failure. For customer-critical workloads, I'm surprised there's not a better integration for alerting or monitoring through Datadog, New Relic, Pagerduty, etc.
-
What additional details or capabilities would you like beyond what you’ve mentioned
Ideally, a Datadog integration that reports metrics for successes, failures, timings, and other information.
-
Whether you see this primarily as a platform ask (observability/monitoring) or a connector/transformation-specific ask
I see this as a platform ask.
-
Please sign in to leave a comment.
Comments
2 comments