Learn how to manage Transformations for dbt Core* in your dashboard.
IMPORTANT: This page applies to Transformations for dbt Core - Scheduled in Fivetran users. Your Transformations page looks different if you use the Basic SQL Transformations or Transformations for dbt Core - Scheduled in Code product. Learn more in the Manage other transformations section.
The Transformations main page lists your active transformations alphabetically by name. You can also view the status and time of each transformation’s last run, the next scheduled run, the run frequency, and the number of connectors associated with that output model.
You can filter the transformations list by the following statuses:
- Succeeded: Your latest transformation run is successfully completed.
- Failed: Your latest transformation run has failed.
- Scheduling Your transformation is being started at the moment.
- Running: Your transformation is currently running.
- Pending: Your transformation has been created but has not started running yet.
To view information about an individual transformation, click on the output model name. Each transformation profile includes a data lineage graph (DLG) and a pane with three tabs:
- Run History: View active and past runs.
- Schedule: View current schedule settings.
- Details: View details about the transformation.
On the Run history tab, you can view your transformation’s recent run history.
If your transformation is not running, the tab displays its next scheduled run. If your transformation is running, the tab displays the progress of the active run.
To learn more about your past runs, go to the Recent Runs list to see your runs from the last 30 days. Each row contains a run’s status, start time, end time, run time, and run type. Click on the run’s name to see the run details.
On the Run details page, you can see the time and duration of the model run, as well as a run log.
On the Schedule tab, you can view and edit your output model’s current schedule settings. There are two schedule options:
- Integrated schedule: Fivetran runs your transformation only when its associated connectors complete syncing. This is the best way to stay up to date and save on costs.
- Custom schedule: Fivetran runs your transformation based on a schedule that you choose.
You can also access the Schedule tab from the main Transformations page. Click the three dots on the right side of the row, then select View schedule.
To edit your output model’s schedule, follow the instructions in the edit transformations section.
On the Details tab, you can view the following information about your transformation:
- Transformation ID: A unique ID that Fivetran assigns your transformation
- Created on: When the transformation was created
- Created by: Who created the transformation
- Average run time: The average duration of the transformation’s runs
- Last edited on: When the transformation was last edited within Fivetran
- Last edited by: The user who last edited the transformation within Fivetran
You can also delete a transformation from the Details tab. Learn how in the delete transformations section.
Edit dbt Core connection settingslink
To view or edit your destination’s dbt Core connection settings, follow these steps:
On the Transformations main page, click Settings.
Edit your dbt Core connection settings, then click Save & Test.
NOTE: If you change your repository, we connect to the new repository and remove all transformations associated with the original repository.
IMPORTANT: You can only add one transformation schedule per output model.
To add a transformation to your Fivetran dashboard, follow these steps:
On the Transformations main page, click +Add Transformation.
Click on the text box to generate a drop-down list of all of the output models in your Git repository that have not yet been scheduled. Fivetran automatically syncs this information from your repository.
Select the output model you want to schedule.
Select Integrated schedule for transformations you want Fivetran to manage, or select Custom schedule to set your own frequency. By default, your transformation runs on the same schedule as its associated connector. You can choose to run your transformation at the following intervals:
- Every 5 minutes
- Every 15 minutes
- Every 30 minutes
- Every hour
- Every 2 hours
- Every 3 hours
- Every 6 hours
- Every 8 hours
- Every 12 hours
- Every 24 hours
You can also choose which days you want your transformations to run.
Click Save. Depending on your schedule settings, the transformation run may not begin immediately (for example, if you create a transformation on Monday that only runs on Wednesday).
NOTE: You can only edit a transformation’s schedule in the Fivetran dashboard. If you want to change the actual SQL statements within the transformation, you must do that in your dbt project.
To edit a transformation’s schedule, follow these steps:
- Go to the transformation’s Schedule tab.
- Edit the schedule settings.
- Click Save.
IMPORTANT: When you delete a transformation, the output model is completely removed from your dashboard and you can no longer view its run history. If you want to schedule this output model later, you must add a new transformation. The new transformation will not include run history from the original model.
To delete a transformation from the Fivetran dashboard, follow these steps:
Go to the transformation’s Details tab.
Click Remove Transformation.
A pop-up window appears with a warning about deleting your transformation. Read it, then click Remove.
You can also remove a transformation on the Transformations main page. Click on the three dots on the right side of the row, then click Remove transformation.
Troubleshoot failed transformationslink
To troubleshoot a failed transformation, use either the DLG or the Run History tab.
On the Transformations page, click on the name of the failed output model.
In the DLG, find the failed transformation. Failed transformations are flagged with a red X as shown below.
NOTE: We do not run any nodes downstream of a failure.
Hover over the failed nodes and click View Logs. A Logs window appears on the right side of the screen.
Read the run log to find out why your transformation run failed.
Go to the failed transformation’s Run History tab.
Go to the Recent Runs list.
Click on the failed run and read the run log to find out why your transformation failed.
Manage other transformationslink
Basic SQL transformationslink
If you have Basic SQL Transformations, your display remains the same until you upgrade to Transformations for dbt Core - Scheduled in Fivetran. Learn how in our Transformations for dbt Core - Scheduled in Fivetran Setup Guide.
Transformations for dbt Core - Scheduled in Codelink
If some of your transformations are scheduled in Fivetran and some are scheduled in code, you have two tabs on your Transformations main page:
Scheduled in Fivetran: Contains the transformations whose schedules are configured in the Fivetran dashboard. Use the instructions in this document to manage your transformations.
Scheduled in Code: Contains the transformations whose schedules are scheduled in the
deployment.ymlfile that you created in your dbt project.
If all of your transformations are scheduled in code, you have a transformation list on your Transformations main page:
In the transformation list, you can view the time and status of each transformation’s most recent run. Click on a transformation to view the Job Details page, where you can do the following:
- Click Run now to manually trigger a transformation run.
- Pause a job by setting the ENABLED toggle to PAUSED.
- View the transformation’s schedule.
- View the start time, end time, duration, and status of each transformation run.
- Click on a run to view a detailed run log.
On the Transformations page, click on an output model in the Output model name column to see its DLG. In the DLG, data flows from left to right. Connectors are in the left column, source tables and intermediate models are in the middle column, and output models are in the right column. Gray lines indicate dependencies between nodes.
NOTE: Within a single DLG, you can see your intermediate models’ schedules, but you cannot modify them. If you want to change the schedule for an intermediate model, you must create it as an output model in a new transformation.
Hover over a node in the graph to see additional details. Depending on the node, you can see either the source table’s full name or the most recent run of a connector, intermediate model, or output model.
TIP: To see more details about the most recent model run, click View Logs.
If your output model depends on upstream tables that Fivetran did not create, those tables are also represented as source table nodes in the DLG.
To see a node’s dependencies, click the node in the graph. A blue line appears that shows its relationship to upstream and downstream nodes.
To filter your DLG by connector, do the following:
- Click Connectors in the top left corner. A drop-down menu appears with a list of connectors associated with your output model.
- Check the box next to one or more connectors. The DLG only shows models downstream of those connectors.
* dbt Core is a trademark of dbt Labs, Inc. All rights therein are reserved to dbt Labs, Inc. Fivetran Transformations is not a product or service of or endorsed by dbt Labs, Inc.