You can use AWS CloudWatch to monitor, store and access your logs from different AWS sources and then retrieve the associated log data.
Using Fivetran’s AWS Cloudwatch Log service, you can connect and stream Fivetran log events to Cloudwatch. You can manage the life cycle of the log events using Cloudwatch’s configuration. You can also search and filter the logs, and setup monitoring or alerting mechanisms based on log events.
How to view logslink
You can view the logs in AWS CloudWatch.
To use filtering options in Cloudwatch:
- Select the log group name you provided in Fivetran’s setup form
- The logs are grouped by the following pattern:
{ACCOUNT_NAME}/{GROUP_NAME}/{CONNECTOR_NAME}/{SCHEMA_NAME}. To see the logs for a specific connector, select an appropriate log group. - To see the logs for the Dashboard activities, select
{ACCOUNT_NAME}/{GROUP_NAME}/dashboard/allgroup. - To see basic SQL transformation logs, select
{ACCOUNT_NAME}/{GROUP_NAME}/transformation/{TRANSFORMATION_NAME}group. - To see dbt transformation logs, select
{ACCOUNT_NAME}/{GROUP_NAME}/dbt/{DBT_JOB_NAME}group.
Setup requirementslink
Please make sure you have an AWS account with ability to grant permission for writing logs.
Setup instructionslink
Please follow the instructions provided in Setup guide.