How To: Define and setup a set of refresh jobs to run in sequence with the HVR scheduler
Overview:
There are times when you have large data set in one table you replicate to a target in a controlled manner or a group of tables you want replicated together but in sequence once a week. This KB will explain how to set up a replication of one target table in smaller group either once or weekly.
Assumptions:
You have defined your source and target locations, location groups and the tables you wish to replicate. You have as well defined a capture action on the source location group and an integrate action on the target location group. You have been running replication but decided you wanted to schedule a refresh a large table once a week.
Steps:
1. Next will define a schedule job for the refresh at the channel level. In this example I have defined my jobs to run every Sat morning at 6am in May (2019) on the 4,11,18 and 25th of the month for the target group location
/RefreshStartTimes="0 6 4,11,18,25 5 6"
2. Then I want to create 3 refresh conditions for the table I want to break up, yr_test and select * so it includes the same condition on both source/target
/RefreshCondition=fiscal_yr<2013 /Context=lt_fiscal_2013 /RefreshCondition="fiscal_yr=2013" /Context=equal_2013 /RefreshCondition="fiscal_yr between 2014 and 2016" /Context=between_2014_2016 /RefreshCondition=fiscal_yr<2013 /Context=lt_fiscal_2013
/RefreshCondition="fiscal_yr=2013" /Context=equal_2013
/RefreshCondition="fiscal_yr between 2014 and 2016" /Context=between_2014_2016
So now your channel should look like this
3. Now lets create refresh/schedule on each refresh condition and have them run sequentially.
Select the target location group and right-click and select Refresh. We are going to both select the restrict context as well as the schedule. Note that each of the refresh jobs we are creating will have three different names.
/RefreshCondition=fiscal_yr<2013 /Context=lt_fiscal_2013
Select Context tab set the group you want to refresh, ie. lt_fiscal_2013
then select the Scheduling tab, change the Taskname
and Click Schedule
Note: The refresh job group attribute, quota_run is set to one by default. It defines a number of jobs which can be run simultaneously. If you want the jobs to run sequentially, leave the value of 1. If you desire to have a set of them run concurrently, specify the number to run concurrently, > 1.
After clicking Schedule, then repeat for the other two with a different task name and context
/RefreshCondition="fiscal_yr=2013" /Context=equal_2013 Change the selection in the Context Tab to 'equal_2013'
then the Scheduling tab, change the Taskname
and Click Schedule to save
Then once again with the third refresh condition
/RefreshCondition="fiscal_yr between 2014 and 2016" /Context=between_2014_2016 Change the selection in the Context Tab
then the Scheduling tab, change the Taskname
and Click Schedule to save
4. Next go back to the Location Groups and right click to select Initialize. Select scripts & jobs only and select the table yr_test
5. There 3 sub-jobs have been defined under the ch1-refr job. Start the refresh jobs by selecting the ch1-refr job and it will execute the refresh in sequence then goes into a PENDING state waiting for scheduled time to restart again
