Skip to main content

Community

Connector Improvement: Twitter - Track Follower Counts over Time

Answered

Please sign in to leave a comment.

Comments

3 comments

  • Official comment

    Hi Matthew Kravetz, Calvin from the Product team here!

    Sorry for the very delayed response & thank you for submitting this request. I think this is a reasonable ask - would providing a date/timestamp field as part of the Composite PK be sufficient? In theory, a new record would be created every time we sync the Twitter Organic connector.

    In the meantime, you should be able to leverage the transformation layer to snapshot the data at different points in time. 

    Hi Calvin, thank you for your response on this!  

    Yes, I think including a timestamp field to the composite PK would address this issue (`_fivetran_synced` would probably work just fine).  We're currently implementing a workaround similar to the one you describe, except we're using DB triggers instead of the transformations layer.

    Best, 

    Matt

    Hi @Calvin, 

    I'm wanting to achieve the same result as Matt. I'm fairly new to Fivetran and am hoping you can point me in the right direction in terms of using the transformations layer to take snapshots? 

     

    Thank you,

    Brandon