New Connector: SSE Compatibility for SDK
AnsweredDescription:
Hello Fivetran Team,
We’re interested in leveraging Server-Sent Events (SSE) for real-time data streaming into our analytics environment. SSE is a technology that allows a server to push data updates to clients over a persistent HTTP connection (via the EventSource API), eliminating the need for frequent polling.
However, we’ve discovered that Fivetran’s approach (including its SDK) is inherently batch-oriented, which means it processes data in discrete batches rather than maintaining a continuous stream. Because SSE is fundamentally a live stream of data rather than periodic chunks, it appears there’s no existing mechanism within Fivetran’s current SDK to capture and process these SSE streams in real time.
-
Official comment
Hi Greg,
Thank you for sharing this idea. I'd be interested to understand more details around the use case you are thinking of for using this fully streaming approach?
Currently Fivetran supports up to 1 minute sync frequency which works for many use cases. We'll consider exploring support for something like this as part of our long term roadmap.
Best Regards
Alison
Please sign in to leave a comment.
Comments
1 comment