Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Dashboard Improvement: NetSuite Connector logs should limit SELECT statements to chosen columns

Completed
Jeff Rotella User
  • Edited

Currently, the logs show a SQL SELECT statement which appears to be selecting every column, regardless of what is chosen in the connector. For instance, if a Transaction table has 100 columns, and you only choose 2, the SELECT statement still shows all 100 columns. This seems like strange behavior and makes debugging difficult. It is also potentially causing Extract times to be magnitudes longer than expected

Please sign in to leave a comment.

Comments

4 comments

Date Votes
  • Official comment
    Erin Fivetranner

    Hi Jeff - Thanks for submitting this feature request. 

    I think this is a valid improvement. We need to validated the speed improvements that this change can have before moving forward with any implementation. 

    I'm curious what specifically you are looking for when you say this makes debugging difficult? Are you looking at the netsuite logs of what Fivetran queries to the source? 

    Best,

    Erin

  • Jeff Rotella User

    Hi Erin, we have a table with something like 300 columns but we only need about 50 of them. I can verify from my own tests outside of Fivetran that it's quick when limiting columns, but extremely long when not limiting them.

    The debugging part may not be relevant now. At first I assumed that the Fivetran logs were just displaying all the columns from the table as part of the SELECT, but not actually including them in the query, and I was trying to understand which were actually being queried. But now I know that it is in fact querying all of them

  • Erin Fivetranner

    Hi Jeff - This improvement has been completed and is being rolled out.  

    Thanks for helping us identify improvements for our connectors! 

  • Jeff Rotella User

    Hi Erin, that's great news. Thank you. I'm still seeing all the unselected columns in the query - do you know approximately when it this will be deployed? And will it automatically happen or will we need to pause and restart syncs?