Connector Improvement: Rollbar Project Destination Schemas merge
AnsweredSee: https://support.fivetran.com/hc/en-us/requests/242595?page=1
Using the Rollbar Connector, we are only allowed to extract 1 project per time. Our Rollbar instance has 150+ projects. Even if we manually setup them up in Fivetran, the result right now is we will have 150+ identical schemas with data from each project that we have to then merge in our datawarehouse.
The request is to do this on your end somehow.
See:
I acknowledge your concern about managing multiple Rollbar projects using Fivetran. I understand that setting up 50 separate connectors can be quite cumbersome and may not seem efficient.
Unfortunately, the current Fivetran's Rollbar connector supports one project extraction through one connector. It doesn't support multiple project extraction through a single connector. I sincerely apologize for any inconvenience caused.
Fivetran requires each connector to have a unique destination schema, so you cannot directly have all 50 Rollbar connectors write to the same schema. However, you can achieve a consolidated view of your data by using post-load transformations. Set up each Rollbar project as a separate connector with its own schema, and then use SQL transformations or dbt to merge the data into a single schema or table after it has been loaded into your destination.
However, if you wish to add this feature, I encourage you to submit a feature request through Fivetran's Feature Request Portal, where you can suggest this functionality and discuss it with the product team.
-
Official comment
Hi Matt,
My name is Unni, and I am a product manager at Fivetran. Thank you for submitting your feature request regarding the Rollbar Connector. We appreciate your input and the detailed description you provided.
We are currently evaluating this request and would like to keep you informed as we prioritize it and move it to our development pipeline. Your insights are valuable to us, and we may reach out for further inputs.
Thank you for helping us improve our services.
Happy data pipelining!
-
Unni,
Thanks so much for giving thoughtful consideration for this. I have been chatting with Sunal Gupta as well on this and he said, "Seems doable - we might be able to pull multiple projects for an account." Please keep Sunal in the loop as well as me as you prioritize this! I would really appreciate it!
-
-
Hello Matt,
We have this in our active backlog and we will get back to you as soon as we pick it up for further analysis and next steps.
Thanks for your patience.
Please sign in to leave a comment.
Comments
4 comments