Skip to main content

Community

Destination Improvement: Optimize the queries written by HVR to load data to Google BigQuery

Planned

Please sign in to leave a comment.

Comments

3 comments

  • Mark Van de Wiel User

    Hi Samyak,

    There is an argument that the BigQuery query optimizer should be smart enough to recognize the ability to use partitioning with the way HVR generated this query.

    However, I also think that it would generally be cleaner if we uplifted the restriction on the driving table out of the sub query.

    Let me discuss with engineering whether we can do this easily.

    Thanks,
    Mark.

  • Mark Van de Wiel User

    FYI Samyak engineering made code changes that are currently in QA. I look forward to releasing this improvement soon.

    Thanks,
    Mark.

    Hi Samyak,

    We have made progress with some engineering work, and it would be probably good to plan some time to discuss those. Let me know when you are open to that.

    Best regards,

    Edwin