Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Connector Improvement: S3 - enable option to include all columns (even those w/o data) in file

Lynzi Ziegenhagen User

Sometimes you need a 1:1 match between every single column in the s3 source file the the fields in the destination database. The current connector does NOT create fields for columns that have a header but none of the rows have data. Would be nice to have a toggle to say "include all columns" or "include those with data". (Note -- Support gave me a work around -- to generate a CSV with a space in between each comma and Fivetran will then generate a column.) 

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Alison Fivetranner

    Hi Lynzi,

    Thank you so much for using Fivetran and for taking the time to submit this request. This is a very interesting idea that I'd love to understand in more depth.
    Can you share more about your Fivetran usage when you find yourself needing this feature?
    What sort of data is it that you are syncing via our S3 connector?
    Why are some of the columns you want to sync completely empty in many files?
    When would you expect to actually populate the column?

    Understanding this information will help me prioritize the ask.

    Thank you once again,

    Alison

  • Paul Sterk User
    • Edited

    I would also like to see this feature.  For the first row in the first csv file: if the column no data for the column, insert a 'null'.

    I had to use a zero and then update the table to set it to null.  Quite a hack.