Connector Improvement: Fivetran Filtering & View Support Query
Not planned
I have a requirement to load filtered data from Postgres (Amazon Aurora PostgreSQL) into Snowflake using the Fivetran Postgres connector "Amazon Aurora PostgreSQL" . To apply the filter logic, I need to join multiple tables with a master table.
1. Is it possible to implement such filtering logic directly in Fivetran?
Additionally, I want to understand the connector capabilities:
2. Does the Fivetran Postgres connector support loading data from database views, or does it only replicate physical tables?
-
Official comment
Filtering can be done via the Row Filtering feature, which can be used with any connector, not just Postgres: https://fivetran.com/docs/core-concepts/features/row-filter#rowfiltering
Replication from views is not supported and planned, because Postgres doesn't publish them in logical replication.
Val Kulichenko,
Fivetran Product Team -
Hi Neema,
Thanks for sharing the request. Currently we don't support neither advanced filtering such as you described, nor views, but that sounds like an interesting use case.
Can you please share the motivation behind the requirement? An obvious solution here can be to replicate all data and create views in the destination; is this something that could work for you, and if not - why? Also, which destination do you use?
Regards,
Val Kulichenko, Fivetran Product Team
Please sign in to leave a comment.
Comments
2 comments