Skip to main content
Support Articles
Feature Requests Documentation Status Dashboard

[Google Cloud PostgreSQL ] Why is the replication of PostgreSQL to Google BiqQuery taking a long time to load to the destination regardless of the dataset size?

Edit on GitHub
  • Updated
Sean Fivetranner

Question

Why is the replication of PostgreSQL to Google BiqQuery is taking a long time to load to the destination regardless of the dataset size?

Environment

Connector: Google Cloud PostgreSQL 
Destination: BigQuery 

Answer

1. Split up the connector into multiple smaller connectors. 

2. Deselect tables from the sync that are not a priority

Cause

Google Cloud PostgreSQL does not support the logical replication of the WAL. Fivetran, therefore, uses the XMIN sync strategy. This results in Fivetran performing full table scans each sync to identify new or updated records.

 

Related articles

Didn’t find what you need?

Contact support