Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Support Google BigQuery as a Source (Capture) Endpoint in Fivetran HVR

Not planned
Naresh Kumar Grandi User

Which application or service?:HVR

What type of connector? (SaaS, Database, File or Event Source): Source

We would like to request the addition of Google BigQuery as a Source (Capture) Connector in Fivetran HVR.

Currently, HVR supports Google BigQuery as a target only and does not provide the ability to use BigQuery as a source database for replication, migration, or data extraction workloads. [fivetran-6...-64bit_ea | Txt]

As organizations increasingly adopt Google Cloud Platform for enterprise analytics, there is a growing need to replicate data from BigQuery to other destinations while continuing to leverage the core HVR platform for orchestration, scheduling, monitoring, and transformation.

 

oyota Motor North America (TMNA) is actively modernizing and consolidating its enterprise data integration architecture around Fivetran HVR.

Several business initiatives require movement of datasets stored in Google BigQuery to other platforms, including:

  • Aurora PostgreSQL
  • Oracle
  • SQL Server
  • Amazon Redshift
  • Databricks
  • Snowflake
  • AWS S3
  • Other enterprise reporting platforms

Currently, these integrations require separate tools, custom extraction frameworks, or cloud-native data movement services.

Adding BigQuery as a source endpoint would:

  • Reduce architectural complexity
  • Eliminate additional ETL tooling
  • Improve operational consistency
  • Lower administration costs
  • Centralize monitoring and auditing within HVR
  • Accelerate cloud migration projects

Desired Capabilities

Phase 1 (Minimum Viable Support)

Support BigQuery as a source for:

  • Initial/Full Refresh
  • Incremental data extraction
  • Table and schema discovery
  • Column metadata extraction
  • Scheduled batch-based replication

Supported targets:

  • Oracle
  • PostgreSQL
  • SQL Server
  • Snowflake
  • Databricks
  • Amazon S3
  • Redshift
  • Other HVR-supported targets

Phase 2 (Enhanced Support)

Support advanced capabilities such as:

  • Change Data Capture (CDC) based on:

    • Audit logs
    • Timestamp tracking
    • Change tracking tables
    • Other BigQuery-native mechanisms

  • Parallel extraction

  • Partition-aware replication

  • Incremental partition scanning

  • Automatic schema evolution handling

Typical Use Cases

Data Lake Consolidation

Replicate curated datasets from BigQuery into AWS-based analytics environments.

Cloud-to-Cloud Migration

Migrate workloads from GCP BigQuery into:

  • Amazon Redshift
  • Aurora PostgreSQL
  • Databricks

while leveraging existing HVR infrastructure.

Cross-Platform Reporting

Move data from BigQuery into operational databases for downstream applications.

Disaster Recovery

Maintain synchronized copies of BigQuery datasets in alternate cloud environments.

Multi-Cloud Strategy

Support organizations operating across AWS, Azure, and GCP from a single HVR platform.

 

Expected Business Benefits

Tangible Benefits

  • Reduced licensing costs for multiple ETL tools
  • Lower development and maintenance effort
  • Reduced infrastructure footprint
  • Simplified operational support

Intangible Benefits

  • Single enterprise replication platform
  • Improved governance and monitoring
  • Faster project delivery
  • Greater architectural flexibility
  • Enhanced cloud adoption initiatives

Competitive Perspective

Several modern data integration platforms provide mechanisms to extract data from BigQuery for downstream replication and analytics workflows.

Supporting BigQuery as a source would significantly strengthen HVR's position as a comprehensive multi-cloud data movement platform and reduce integration gaps for customers adopting Google Cloud.

 

Requested Outcome

We respectfully request that the Fivetran HVR Product Management and Engineering teams evaluate and prioritize:

Google BigQuery Source (Capture) Connector Support

with support for:

  1. Full Refresh extraction
  2. Incremental extraction
  3. Metadata discovery
  4. Partition-aware processing
  5. Future CDC capabilities

This enhancement would provide substantial value to customers operating in hybrid and multi-cloud environments and would enable broader adoption of HVR as a strategic enterprise data replication platform.

 

urrent Product Limitation Reference: Google BigQuery is currently documented as"target only (not supported as hub or capture)" in the HVR platform compatibility documentation.

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Edwin Fivetranner

    Hi Naresh

    Thanks for the detailed feature request and for outlining the use cases and desired capabilities.

    HVR already supports Google BigQuery as a source for Refresh (snapshot) operations. However, this support is limited and does not include capabilities such as automatic CDC or DDL/schema change capture.

    We currently have no plans to extend HVR's BigQuery source support with incremental or CDC capabilities.

    For use cases that require ongoing incremental replication from BigQuery, the Fivetran managed service supports BigQuery as a source, including incremental sync capabilities:

    https://fivetran.com/docs/connectors/databases/bigquery

    Given the requirements described here, we recommend evaluating the managed BigQuery connector for these workloads.

    Best regards,

    Edwin