Dashboard Improvement: Update a cloud function connector's state variable manually
Background:
We have been using the Fivetran Lambda connector to ingest non-Fivetran supported sources. At the end of each ingestion iteration, the lambda code will return a customised state variable back to Fivetran to store the states.
In some scenarios the state variable gets stuck with incorrect values which are returned to Fivetran so the next execution Fivetran will send these bad values back to AWS Lambda. In order to recover from the error and having the Fivetran store the correct state, we currently have to:
- Re-sync historical data (may take a long time) Or;
- Modify the lambda code temporarily to correct the state vairable manually
Feature request:
It would be great if we could have a feature to allow user to update/modify the state variable at the frontend. After saving the changes in the frontend, Fivetran will return the new values in the next request.
-
Official comment
Hi Nicole,
Thank you for using Fivetran and for taking the time to submit such a well thought through feature request.
I do have a few follow up questions around exactly how we get into this state where we are returning incorrect values. I'd like to explore if we can avoid that situation before exploring additional features and functionality to deal with it.
I'm going to switch to email for the follow up.
Thank you once again.Alison
-
This would be nice - either via the UI or the API. Alternately, adding a per-table resync option would work too.
Please sign in to leave a comment.
Comments
2 comments