Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Transformations: Hybrid transformations

Answered
Leonardo Harada User

Currently we have the hybrid agent (AWS EC2 on Docker) installed on premises, it works for extraction and loading, then we tried to use transformations from the dashboard, but the transformations are not executed on premises, I need to expose to the internet my database in order to make it reachable from the Fivetran dashboard, which defeats the purpose of having a hybrid solution because we want to avoid the data exposure.

This request is for having an agent that can be installed on premises for transformations work. Following the same pattern as the hybrid agent for Extraction and loading, but this one listening for transformation jobs and execute those within on premises.

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Jimmy Fivetranner

    Hi Leonardo,

    Do you have a security policy to never publicly expose your database? A big part of the hybrid model is that data never leaves your premises, and we figured that because transformations are executed in the destination it aligns with that model. Lemme know how your team considers this and we can prioritize!

    Jimmy

  • Leonardo Harada User

    Hi Jimmy, thank you for reaching out, yes currently in our product we are taking the opposite direction (From cloud to Data center) because strict regulations on data residency among our customers and partners, we took the hybrid approach because the hybrid agent extracts and loads within our network and it only exchange information with Fivetran cloud related to jobs or other metadata, having your cloud executing the transformations within our network defeats the purpose of having the data center, I mean in theory you execute the transformations locally, but leaves room for auditors or customers with the uncertainty of "does it really leave our data in our server?"

    I would like to understand more, why is not possible to have a hrybrid agent in charge of transformations, the same as the extraction and loading.

    Thank you.