Fivetran wants to provide more information about how your connectors are running so you can diagnose your own issues. Fivetran Log Connector syncs the logs to a table. It also syncs metadata about your connectors.
Featureslink
| Feature Name | Supported | Notes |
|---|---|---|
| Capture Deletes | check | USER and CONNECTOR tables |
| Custom Data | ||
| Data Blocking | ||
| Column Hashing | ||
| Re-sync | check | Connector level |
| History | ||
| API Configurable | check | |
| Priority-first sync | ||
| dbt Package | check | Get the package |
Setup guidelink
Follow our step-by-step setup guide to set up your Fivetran Log Connector.
Sync Overviewlink
Fivetran Log Connector syncs the latest logs generated from your connectors to your destination. It syncs additional information about the account, destination, connectors, users, and membership present in your Fivetran account. We sync all these details at a destination level.
If you are an account owner, you can also choose to sync all the connector logs for all the destinations in your account. By limiting this option to account owners, we ensure that Powered By Fivetran (PBF) customers cannot access logs that belong to other PBF customers on the same account.
Schema informationlink
This schema applies to all Fivetran Log Connectors.
To zoom, open ERD in new window.
Schema notes - Important tableslink
The ACTIVE_VOLUME table provides details of the monthly active rows (MAR) for each destination schema, the associated tables, and the time when the MAR is calculated.
| Column Name | Description |
|---|---|
connector_id |
The ID of the connector for which the MAR is calculated. |
monthly_active_rows |
The number of distinct primary keys synced for the connector. |
measured_at |
The timestamp when the MAR is calculated. |
schema_name |
The destination schema name for which the MAR is calculated. |
table_name |
The table name associated with the MAR. |
The LOG table provides a record of events that have occurred for a particular connector along with the event details.
| Column Name | Description |
|---|---|
connector_id |
The ID of the connector for which the event is logged. |
event |
The event type. Events can be classified as a warning, an error, or just an information log. |
message_event |
The routine involved in the log. |
message_data |
The details of the event in JSON format. |
The CREDITS_USED table provides information about the monthly credit usage summary.
| Column Name | Description |
|---|---|
destination_id |
The ID of the destination for which the credits are used. |
measured_month |
The month in which the credits are used. |
credits_consumed |
The number of credits used during the month. |
Error logslink
These logs contain information about errors that connectors encounter. You can track events, such as a failure or an authentication error from the logs.
The following table lists the errors with a SEVERE severity level:
| SEVERITY | EVENT_TYPE | PROPERTY_NAME | VALUE |
|---|---|---|---|
| SEVERE | status | status | FAILURE |
| SEVERE | status | status | FAILURE_WITH_TASK |
| SEVERE | error | type | dynamically obtained from response |
| SEVERE | error | type | open_file |
| SEVERE | error | type | null_primary_key |
| SEVERE | error | type | authentication_error |
| SEVERE | error | type | permission_denied |