Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Combining individual sftp connectors under a group automatically

Answered
Mary Morrison User

Which connector?:

SFTP

Additional details:

When originally setting up our SFTP connectors we had 1 connector per file.

A newer feature has been introduced (Table Group) where we can group sftp connectors/files but they each maintain their integritity with a 1 file to 1 table relationship

It would be nice to collect our individual sftp connectors under 1, or more, group(s) to make thier function more clear. For example, a customer address file, customer support summary and customer audit could be organised under a single CUSTOMER table group. This would make purpose clearer and make it easier to find related connectors.

It would also be nice to move sftp connections from one overarching group to another automatically eg customer audit might move from Customer to Governance.

When I say automatically, I'd be happy if this was an import/export function where we have to do a little work to get the configuration right by exporting the single connector, changing key details such as the group name, and reimporting it to sit under the required Table Group. 

Please sign in to leave a comment.

Comments

1 comment

Date Votes
  • Official comment
    Parmeet Kohli Fivetranner

    Hi Mary,

    Thanks for the detailed write-up. This is really helpful context.

    If you'd like to consolidate your existing single-file connections, we have this script to help with a one-time migration. It will need a couple of tweaks for your setup. I'll reach out to set up some time.

    For any new SFTP connections you set up going forward, you may want to consider Dynamic Table Mapping. It lets you ingest multiple files into multiple tables under a single connection without needing to define a file pattern-to-table mapping for each table individually, which sounds close to what you're describing with the CUSTOMER group example.

    On the tables-moving-between-connections idea, noted. I'll log this as product feedback.

    Thank you,
    Parmeet