Support Google BigQuery as a Source (Capture) Endpoint in Fivetran HVR
Which application or service?:HVR
What type of connector? (SaaS, Database, File or Event Source): Source
We would like to request the addition of Google BigQuery as a Source (Capture) Connector in Fivetran HVR.
Currently, HVR supports Google BigQuery as a target only and does not provide the ability to use BigQuery as a source database for replication, migration, or data extraction workloads. [fivetran-6...-64bit_ea | Txt]
As organizations increasingly adopt Google Cloud Platform for enterprise analytics, there is a growing need to replicate data from BigQuery to other destinations while continuing to leverage the core HVR platform for orchestration, scheduling, monitoring, and transformation.
oyota Motor North America (TMNA) is actively modernizing and consolidating its enterprise data integration architecture around Fivetran HVR.
Several business initiatives require movement of datasets stored in Google BigQuery to other platforms, including:
- Aurora PostgreSQL
- Oracle
- SQL Server
- Amazon Redshift
- Databricks
- Snowflake
- AWS S3
- Other enterprise reporting platforms
Currently, these integrations require separate tools, custom extraction frameworks, or cloud-native data movement services.
Adding BigQuery as a source endpoint would:
- Reduce architectural complexity
- Eliminate additional ETL tooling
- Improve operational consistency
- Lower administration costs
- Centralize monitoring and auditing within HVR
- Accelerate cloud migration projects
Desired Capabilities
Phase 1 (Minimum Viable Support)
Support BigQuery as a source for:
- Initial/Full Refresh
- Incremental data extraction
- Table and schema discovery
- Column metadata extraction
- Scheduled batch-based replication
Supported targets:
- Oracle
- PostgreSQL
- SQL Server
- Snowflake
- Databricks
- Amazon S3
- Redshift
- Other HVR-supported targets
Phase 2 (Enhanced Support)
Support advanced capabilities such as:
-
Change Data Capture (CDC) based on:
- Audit logs
- Timestamp tracking
- Change tracking tables
- Other BigQuery-native mechanisms
-
Parallel extraction
-
Partition-aware replication
-
Incremental partition scanning
-
Automatic schema evolution handling
Typical Use Cases
Data Lake Consolidation
Replicate curated datasets from BigQuery into AWS-based analytics environments.
Cloud-to-Cloud Migration
Migrate workloads from GCP BigQuery into:
- Amazon Redshift
- Aurora PostgreSQL
- Databricks
while leveraging existing HVR infrastructure.
Cross-Platform Reporting
Move data from BigQuery into operational databases for downstream applications.
Disaster Recovery
Maintain synchronized copies of BigQuery datasets in alternate cloud environments.
Multi-Cloud Strategy
Support organizations operating across AWS, Azure, and GCP from a single HVR platform.
Expected Business Benefits
Tangible Benefits
- Reduced licensing costs for multiple ETL tools
- Lower development and maintenance effort
- Reduced infrastructure footprint
- Simplified operational support
Intangible Benefits
- Single enterprise replication platform
- Improved governance and monitoring
- Faster project delivery
- Greater architectural flexibility
- Enhanced cloud adoption initiatives
Competitive Perspective
Several modern data integration platforms provide mechanisms to extract data from BigQuery for downstream replication and analytics workflows.
Supporting BigQuery as a source would significantly strengthen HVR's position as a comprehensive multi-cloud data movement platform and reduce integration gaps for customers adopting Google Cloud.
Requested Outcome
We respectfully request that the Fivetran HVR Product Management and Engineering teams evaluate and prioritize:
Google BigQuery Source (Capture) Connector Support
with support for:
- Full Refresh extraction
- Incremental extraction
- Metadata discovery
- Partition-aware processing
- Future CDC capabilities
This enhancement would provide substantial value to customers operating in hybrid and multi-cloud environments and would enable broader adoption of HVR as a strategic enterprise data replication platform.
Please sign in to leave a comment.
Comments
0 comments