Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Create Schema - required for DBRK setup

Answered
Nitin Bhagat User

The requirement here is that create schema should not be part of the prerequisite for Databricks. The Schema should be created manually at the Databricks end and then the user should be able to use that schema.

This would mean that there should be no prerequisite at the connector end for schema creation and if the privilege is not granted the setup should complete.

The use case team is asking to revoke CREATE SCHEMA privilege. 

[Fivetran Support] # 322682

Please sign in to leave a comment.

Comments

4 comments

Date Votes
  • Egidio Terra Fivetranner
    • Edited

    Hi Nitin,

    Thanks for bringing this to our attention. Can you elaborate on the reasons the schema should not be created by Fivetran?

    Best,

     

  • Nitin Bhagat User

    As per Novartis standard No schema should be created without S3 path. When Fivetran automatically creates the schema, the Data directly lands into the platform managed path where there is no encryption. So, the use case team is asking to remove this privilege for the list.

  • Egidio Terra Fivetranner

    Hi Nitin,

    This privilege is required during connector creation and whenever a new schema is selected within an existing connection. Alternatively, you may configure Delta tables to be created in a user-provided external location rather than in Databricks-managed storage.

     

    Best regards,

  • Egidio Terra Fivetranner

    Hi Nigin,

    We're revisiting this request and want to understand your process. Fivetran can create schemas dynamically as new ones appear in the source, so we'd like to know how you handle those. We're also curious about your workflow for creating a schema before setting up a pipeline, since creating a connector in Fivetran requires specifying a schema name upfront.

    Best,