Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: json file as destination file format when synching mongo db

Answered
ganesh shet User

hi currently the mongo db connector after the sync writes file in parquet format in s3 destination requesting to have json file format for better sync and data usage 

Please sign in to leave a comment.

Comments

2 comments

Date Votes
  • Official comment
    Meera User

    Hi Ganesh - thanks for submitting this request! At the moment, support for JSON is not planned. Every upvote on this request increases the case to build it.

    I do have a few questions to help me understand the request better. What are the use cases for which JSON is preferred? Could I learn a bit more about how the JSON file is consumed or parsed downstream? 

    Thanks so much,

    Meera

     

  • ganesh shet User

    hi meera , 

    our use case is we a re syncing data from mongo db to s3 but in s3 the file format is parquet which is nested not flattened for our requirement we need a flattened file but we are facing issues when we try to flatten the parquet file and hence thought of json as an alternative which is easier compared to parquet any suggestions ?