Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Connector Improvement: Log GCP Cloud Storage Filename for Reporting Purposes

Ben Liyanage User

Currently it is not possible to report on whether a file has been loaded or not when the file content is empty.  Can we add a log message that includes the file name that has been successfully processed?  Then we can use this information to report that the file has been loaded.

Please sign in to leave a comment.

Comments

3 comments

Date Votes
  • Official comment
    Alison Fivetranner

    Hi Ben,

    Thank you for taking the time to share you feedback on our Storage connector. I am a little confused by your description given you say the file is empty - so how can the data get loaded? Can you share a little be more about the problem you are trying to solve with this ask?

    We are considering options in this area, however we need to ensure any solution scales and performs well given there are potentially 1,000's of files that don't contribute any data to the destination warehouse but have to be considered by our file connector every sync.

    Best regards

    Alison

  • Ben Liyanage User

    The file only contains a header row.

  • Alison Fivetranner

    Hi Ben,

    Thank you for responding, however I'm missing the bigger picture. Can you tell me more about how you are using our GCP Cloud Storage connector such that you need to know we've looked at a file that only contains the header data and send it's data (all 0 rows of it) to the warehouse.

    Thanks so much

    Alison