Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

New Destination: Spark Destination

Not planned
Anthony Chamberas User

I use DBT to transform data that is stored in a Spark SQL database.  Currently my workaround for Fivetran is to send data to a postgres database, and then create temporary external views from Spark SQL to the postgres DB.

It would be nice to have spark as a destination, especially since DBT has it as a source.

Please sign in to leave a comment.

Comments

3 comments

Date Votes
  • Official comment
    Kevin Kim Fivetranner

    Hi Anthony,

    Thanks for your post in our feature request portal!

    Would you have more information on how you are using Spark and what your use case is?

    I don't have a timeline for supporting Spark as a destination, but please know this feedback is valuable. Each upvote and comment will help build the case for prioritizing this new destination!

  • Anthony Chamberas User

    my use case is to be able to load data into Spark so that I can leverage the spark compute engine to run predictive models directly on the data, rather than accessing data from a remote source.

  • Brad Fultz User

    My organization wants to shift from databricks to Synapse, so for FiveTran to remain effective, it would have to be able to write Synapse Spark.