Connector Improvement: GitLab connector - add a Start Time filter
AnsweredFor our small company of about ~30 devs it costs ~$1500/month to ingest the data from gitlab into Databricks. That's an amount we're not willing to pay and we're considering turning it off completely since we don’t need the CI/CD timing graphs that badly. And the data will only keep growing... Need to solve this by limiting by time. A couple of options:
- rolling time window -- ingest only X number of days/weeks/months
- ingesting since a static date is fine too
-
Official comment
Hi Yegor,
Thank you for sharing your feedback about GitLab data ingestion. We understand the concern around data growth and costs for smaller teams.
We’ve noted your suggestion to support time-based ingestion controls, such as a rolling window or static date option. Your input helps us evaluate and prioritize improvements for this connector.
Thanks again for your valuable feedback.
Best,
Sisan
Please sign in to leave a comment.
Comments
1 comment