Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: AWS S3 connector support for multiple table with single connector based on file pattern

Completed
Ritendra Dhakciya User
  • Edited

Do we have a feature available where we can read folder wise file and dump data into their respective table with single connector. 
Currently as per documentation we need to build 3 connectors if have 3 different folder in S3 bucket to dump data into 3 table. Please let me what are feasible solution.

We are looking for option where we can define a pattern for same type of file in a Single folder into a single table. So with this we don't need to build many connector for single folder to handle multiple files into multiple tables.



Thanks
Ritendra Dhakciya


Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Alison Fivetranner

    Hi Ritendra,

    Thank you for trying Fivetran. We don't have that feature today, our customers have so far been happy to use our API to setup multiple connectors each for different folders.

    One of the advantages of our current design is that if you have files in subfolders they automatically get detected and synced to your table too, this is very powerful when you have large numbers of files - I don't think that would be possible with the approach you suggest.

    Best regards

    Alison

  • Parmeet Kohli Fivetranner

    Hi Ritendra, thanks for raising this feature request. You are now able to add multiple tables to a single S3 connection.

    Best,
    Parmeet