Note: You can connect Fivetran to a read replica of your Azure MariaDB database to ensure that we don’t add any strain to your master database. Many production environments include a read replica by default; if yours doesn’t, you can create one.
Follow these instructions to replicate your Azure MariaDB database to your destination via Fivetran.
To connect your MariaDB database to Fivetran, you need:
- MariaDB 10.1.2 or above
- Your database host’s IP (e.g.,
220.127.116.11) or domain (
- Your database’s port (usually
- A unique replica ID for Fivetran. We need this ID because we connect to your database as a replica. We provide a random replica ID in your setup form, but you can provide your own if you’d prefer or if the form’s replica ID conflicts with one of your existing replica IDs.
NOTE: The replica ID is a unique ID within the MySQL replica set. By default, the replica ID is a random integer greater than 1000.
MariaDB versions earlier than 10.1.2 may function correctly with the exception of fractional seconds in TIME, TIMESTAMP, and DATETIME columns. Prior to version 10.1.2, fractional seconds were stored differently, which causes problems with our incremental updates.
For the prerequisites for connecting via an SSH tunnel, see Fivetran’s Connection Options page.
Choose your connection optionlink
First, decide whether to connect Fivetran to your Azure MariaDB database directly or through an SSH tunnel. How you configure security groups will differ based on your connection method.
Fivetran connects directly to your database instance.
Connect via SSHlink
Fivetran connects to a separate server in your network which provides an SSH tunnel to your database. You must connect through SSH if your database is contained within an inaccessible subnet. If you have an SSH connection, follow these instructions before you proceed to the next step.
Allow Fivetran to access your databaselink
You must configure your firewall to grant Fivetran access to your database.
Open the SQL database firewall settings in the Azure consolelink
In the Azure console, select your Azure MariaDB resource.
Open the Connection security tab.
Add a new firewall rulelink
If you are connecting directly, create a new rule using Fivetran’s IP as both the Start IP and End IP. If you are connecting through SSH, use your tunnel server’s IP.
Create a Fivetran userlink
Next, create a Fivetran user for your Azure MariaDB database. If you are connecting Fivetran to a read replica, you must create the user on your master database because read replicas are read-only. Your read replica will inherit the user from your master database.
Open a connection to your Azure MariaDB database using your favorite SQL tool (for example, MariaDB Workbench or the
mysqlcommand in your operating system’s terminal window).
Create a Fivetran user and grant replication permissions by running the following SQL commands. Replace
'password'with a username and password of your choice.
CREATE USER <username>@'%' IDENTIFIED BY 'password'; GRANT SELECT, REPLICATION CLIENT, REPLICATION SLAVE ON *.* TO <username>@'%';
If there are errors when running these commands, you may lack sufficient privileges and should contact your database administrator.
Configure replica for history mode (optional)link
If you have connected Fivetran to a read replica and plan to run your connector on history mode, do the following:
Open a connection to your read replica.
Check your read replica’s
0, you do not need to any additional configuration.
slave_parallel_threadsvalue is not
0, you must set the
minimalto use in-order parallel replication. Learn more about parallel replication in MariaDB’s parallel replication documentation.
Set binary log format to ROWlink
By default, Azure MariaDB’s binary log format is MIXED. You cannot alter this system setting from the Azure dashboard or from any database tool. To change your binary log format to ROW, file a ticket with Microsoft Azure support. Fivetran needs ROW format binary logs to perform incremental updates.
Select schema and tableslink
Select which schemas and tables you’d like to sync to your destination.
Choose a schema prefixlink
Fivetran maps the schemas we discover in your source database to your destination and prepends the destination schema names with a prefix of your choice. For example, if your original database contains schemas
bar and if you choose the prefix
pre, then your destination schemas will be
Enter user and password in setup formlink
In your Fivetran setup form, enter your user and password.
- For the User, enter
<servername>is part of your Azure host URL:
- For the Password, enter the password you set when you created the Fivetran user.
Fivetran performs the following tests to ensure that we can connect to your Azure MariaDB database and that it is properly configured:
- The Connecting to SSH Tunnel Test validates the SSH tunnel details you provided in the setup form. It generates a pop-up window where you must verify the SSH fingerprint. It then checks that we can connect to your database using the SSH Tunnel. (We skip this test if you are connecting directly.)
- The Connecting to Host Test verifies that the database host is not private and checks that we can connect to the host.
- The Validating Certificate Test generates a pop-up window where you must choose which certificate you want Fivetran to use. It then validates that certificate and checks that we can connect to your database using TLS. (We skip this test if you are connecting using an SSH tunnel and did not choose to require TLS.)
- The Validating Database User Test validates the database credentials you provided in the setup form.
- The Checking Database Configuration Test verifies that we can find your database’s server ID. It then checks your binary log configuration and confirms that we can connect to the binary log.
- The Validating Database Type Test checks that your database type matches the connector type. For example, this test will fail if you try to set up an Azure MariaDB connector with a generic MariaDB database.
- The Validating Speed Setup test checks how quickly Fivetran can fetch data from your source database. The test will show a warning if the speed is low, that is less than 5MB/sec.
NOTE: The tests may take a few minutes to finish running.