Other: HVR to increase the Snowflake warehouse size when it detects a large router file
The following feature request arrived to my queue:
"We have replication from an Oracle database to Snowflake and for 90% of the time a x-small warehouse size is sufficient. We do however get large router files from time to time during the day. They vary from 4G to 9G in size and the timings for these are unpredictable. These anomalies cause the replication to fall behind due to a x-small warehouse not being powerful enough to process the file in a reasonable time. We experimented and for these large files we need a LARGE warehouse size. If we knew exactly when they were going to show up we could schedule a warehouse resize to scale the size up to a LARGE until they are processed and then tune back to a x-small."
Can a feature be added to the integrate action to tell HVR to increase the Snowflake warehouse size to a specified size when it detects a large router file landing in the router destination, it can then fall back to the smaller size when the file is processed?
Please sign in to leave a comment.