Connector Improvement: Add the ability in Cloud Functions to sync data via DataFrame rather than JSON
CompletedWe write Cloud Functions in Python, and in our experience, taking an API response and applying pandas.json_normalize() is easier, less time-consuming, and more performant than parsing/reformatting an API response to fit Fivetran's specific return format.
-
-
Hi Nick,
Thank you for sharing a great idea. I'd love to get a better feel on how valuable this would be to add.
How many functions have you written in Python where this would be the preferred way of creating a payload?
Any other customers similarly experienced this issue and able to share/upvote the need?Best regards
Alison
-
Hi Alison,
Thank you for responding to this feature request. We're in the process of writing one Lambda function using pandas.json_normalize(), although for our specific use case, we can't use that Lambda function with Fivetran.
For the reasons I initially mentioned in this feature request, we'd like to start using pandas.json_normalize() in all of our Lambda functions.
That being said: in my opinion, this feature request is less important than other feature requests I've submitted:
Best,
Nick
-
Nick,
I really appreciate your following up
Alison
-
4709764898
Please sign in to leave a comment.
Comments
5 comments