Connector Improvement: [Confluent Kafka] performance improvement
Hello,
This is a follow-up to the support request #195269,
Context: We set up a new Confluent Cloud connector to sync data from Kafka to Snowflake
Problem: Initial sync took 5.5 hours for ~500MB and 650k records. For such small volumes, we would expect the sync to take less than 1 min. Furthermore, we had no way to investigate what was happening.
As discussed in the support request, we are raising a feature request to improve the performance of the connector. Today, we use it for non-business critical data flows, but such performance prevent us from considering Fivetran for anything business critical.
-
Official comment
Hi Christian, thanks for submitting this request! It is timely as we are focussed on improving performance across our connectors. Noted regarding Confluent Cloud and I'll keep you posted about any updates.
Best,
Parmeet
Please sign in to leave a comment.
Comments
1 comment