Support Databricks Lakebase as a Source Connector
Planned
Which application or service?: Databricks Lakebase
What type of connector? (SaaS, Database, File or Event Source): SaaS
Additional details:
Would like Fivetran to support Databricks Lakebase as a source connector.
Currently, Lakebase is supported only as a destination, but we have use cases where data stored in Databricks Lakebase needs to be replicated to other destinations using Fivetran.
Desired capabilities:
- Use Databricks Lakebase as a source connector.
- Support both initial load and CDC/incremental replication where available.
- Ability to replicate selected schemas and tables to supported Fivetran destinations.
- Support for standard database connector capabilities such as schema discovery, column mapping, and change tracking.
This feature would help simplify data integration workflows and reduce the need for custom extraction solutions when Lakebase serves as an operational data source.
-
Official comment
Hi Prem,
Since Lakebase is based on Postgres, you should be able to use Fivetran's standard PostgreSQL connector. Two caveats, however:
- Logical replication is not supported for Lakebase at the moment, which means that only query-based replication is available.
- We haven't tested this yet. I will work with the engineering team to do so in the near future. Please feel free to try yourself as well in the meantime, and report any issues to us.
Thanks,
Val Kulichenko, Fivetran Product Team
Please sign in to leave a comment.
Comments
1 comment