Skip to main content
Docs
Feature Requests Onboarding Trust Center Status Page

Community

Other: Prune JournalRouterFiles from Integrate configuration

Answered
Max Di Santi User

Hi Team, we have few channels that Integrate Job has been set to keep /JournalRouterFiles, but this is causing disk to get full in a short term. As HVR doesn't has any way to rotate/delete these older files in a schedule basis, can you please work on a new feature to improve this settings?

E.g.: X days / X months

Thanks!

Max

Please sign in to leave a comment.

Comments

3 comments

Date Votes
  • Mark Van de Wiel User

    Hi Max,

    Sorry for the delayed response.

    Journaling router files is a capability that is dominantly meant for troubleshooting. It is not enabled by default. The support team may recommend we enable it in order to gather more information when running into a problem that is not easy to reproduce.

    Do you enable JournalRouterFiles for troubleshooting? I'd like to understand why you enabled it and why you would want to keep it enabled.

    Note you could schedule a daily or weekly cron job on a Linux hub to perform something like this (to delete files modified more than 7 days old; substitute your hub name):

    find $HVR_CONFIG/hubs/<hub name>/channels/*/locs/*/jnl/ -depth -mtime +7 -type f -delete

    Hope this helps.

    Mark.

  • Max Di Santi User

    Hi Mark, thanks for your reply.

    We have had to leave this option enable due to data missing from a client, that is using Kafka as target.

    Client required to keep it enabled in case that some data loss happen again, in order to understand if the missing data was missed into the target or never came from the source. As we didn't have a way to verify that in the past, HVR Support suggested to use JournalRouterFiles to keep transaction files on the hub server, so when new data loss happen again, we can go and see if that was or wasn't part of the replication process.

    If that is not finally found in RouterFiles, then that is a good point to start to do not thing that HVR missed it.

  • Max Di Santi User

    Hi Mark, I hope you are good. I would like to ask specifically for journal_keep_days to be added to the HVR6 maintenance/scheduled-task framework as we relied on this in HVR5. Our use case as I highlighted in my last comment. Hope this can be considered for future release. We are using HVR 6.3.0 now.