Submind YouTube summaries
Thumbnail for HA Testing Strategy Every Platform Engineer Needs | Cassius Rhue, SIOS

HA Testing Strategy Every Platform Engineer Needs | Cassius Rhue, SIOS

Watch on YouTube

Video summary

One of the most significant hurdles organizations encounter when attempting to conduct high availability tests within production environments is securing approval from business stakeholders for the necessary maintenance windows. Stakeholders are often deeply reluctant to allow critical systems to go offline, particularly given that even a single hour of downtime can result in losses as severe as $300,000. To overcome this hesitation, system administrators must effectively communicate the value of proactive testing by framing it not merely as an operational cost but as a strategic investment that prevents far more expensive chaos later on. By explaining how regular tests avoid scenarios where teams scramble to diagnose misconfigured backup servers, version mismatches between applications, or client reconnection failures, leaders can build a compelling business case for scheduling these interruptions during periods of lowest criticality rather than facing extended outages caused by undiscovered issues. To further mitigate risk and reduce stakeholder anxiety regarding production testing, experts recommend establishing a like-for-like copy of the live environment specifically designed as a QA sandbox. This approach involves replicating all essential services, databases, applications, test clients, mock data, and supporting software found in production to create an isolated space for rigorous validation. By thoroughly exercising failover procedures, runbooks, and architectural components within this mirrored setup, teams can gain substantial confidence that their systems will perform correctly under pressure before ever touching the live infrastructure. While utilizing a dedicated QA environment significantly lowers the frequency of required interruptions on actual production servers, it is important to recognize that such simulations do not completely eliminate risk; therefore, some level of testing must still occur directly within the production environment to ensure absolute readiness for real-world crises. Ultimately, the goal of implementing this dual-layered strategy is to shift the organization's mindset from reactive firefighting to proactive resilience management. When businesses understand that a fixed cost incurred during a planned maintenance window prevents unpredictable and potentially catastrophic downtime caused by latent configuration errors or data synchronization issues, they are more likely to support regular testing schedules. This cultural shift ensures that when an actual crisis does occur, the team can rely on validated procedures rather than guessing what went wrong in the heat of the moment. By balancing thorough validation in a safe replica environment with targeted production checks, organizations can maintain high confidence in their system's availability while minimizing both financial loss and operational disruption for their stakeholders.
Read the full video transcript
Can you talk about what are the biggest challenges organizations face when testing HA environments in production and how can they reduce risk while still building confidence in their system? >> Yeah, so one of the the biggest challenge I'd say the the biggest challenge I have seen organizations face when trying to test HA environments in production is securing agreement from the business stakeholders for the maintenance window required uh for that testing. Uh that's also, you know, getting business justification and building a story for the key stakeholders to sign off. Uh we're talking about uh systems where uh even 1 hour of downtime could be as expensive as $300,000. Uh these stakeholders are very hesitant to have those systems offline. And so, the challenge becomes for those who are responsible for maintaining those systems or responsible for guaranteeing that the system will be available in a crisis, uh that failover will work, is is making those stakeholders aware that doing this proactive testing uh while it may cost some time uh for the system to be offline or in maintenance mode, uh it also adds some resource cost that you can explain to them the savings that happen when you're not in chaos mode. Uh when you're not scrambling to figure out uh what happened, why the backup server is not properly configured, or why there's an error between application versions, or why some particular client application is unable to reconnect. Uh so, articulating the value uh will help you overcome that challenge uh for businesses that are are really hesitant to take a maintenance window for that. Um the other way to, you know, to so reducing that risk or hesitancy is just articulating the value of doing testing in in right? Um making them aware that taking a proactive measure might cost one fixed amount at a particular time in the year where it's uh least critical to the business, but having a downtime extended by hours because it's uh you discovered the backup servers and not configured properly, clients are hardcoded to a particular address, or or data hasn't been synced properly. Uh you want to avoid that and just explain to the business that uh in the long run doing that testing reduces the cost and risk of chaos. Um, another way that I advise our our customers to reduce the risk and and reduce that kind of hesitancy about using HA production systems for all of your testing is to make a like-for-like copy of your production environment, right? So, that's establishing a QA environment that has the same services, databases, or applications that are going to be made highly available, making sure you have uh test clients, and that you have sufficient mock data and other supporting software in this QA environment, and then you can go through a lot of your test and have the confidence that things are going to work uh because you've validated a lot of your architecture, you've validated a lot of your procedures and runbook, and that does reduce the risk. Now, I want to say that reduces the risk and the the hesitancy of testing in production, but it does not eliminate it. You still need to test in your production environment. It just reduces how much testing you would have to do on a frequent basis.