Connector Improvement: Twitter - Track Follower Counts over Time
AnsweredHi,
I would like to be able to track the count of followers for a Twitter account over time.
The `twitter_user_history.follower_count` field presently tracks the current follower count, however this value is updated in-place with each sync. If this connector/table were updated to support History Mode I believe that would be sufficient for us to track follower counts over time.
Thank you!
-
Official comment
Hi Matthew Kravetz, Calvin from the Product team here!
Sorry for the very delayed response & thank you for submitting this request. I think this is a reasonable ask - would providing a date/timestamp field as part of the Composite PK be sufficient? In theory, a new record would be created every time we sync the Twitter Organic connector.
In the meantime, you should be able to leverage the transformation layer to snapshot the data at different points in time.
-
Hi Calvin, thank you for your response on this!
Yes, I think including a timestamp field to the composite PK would address this issue (`_fivetran_synced` would probably work just fine). We're currently implementing a workaround similar to the one you describe, except we're using DB triggers instead of the transformations layer.
Best,
Matt
-
Hi @Calvin,
I'm wanting to achieve the same result as Matt. I'm fairly new to Fivetran and am hoping you can point me in the right direction in terms of using the transformations layer to take snapshots?
Thank you,
Brandon
Please sign in to leave a comment.
Comments
3 comments