Why haven’t I heard of this sooner? Fascinating! Apparently Netflix started Chaos Monkey, a tool to test your infrastructure.
It randomly terminates one system or something random in your environment. You get to deal with the ensuing ‘chaos’ to see how well you find it, recover, etc.
Sounds like it’s a mature tool for a mature program, but interesting. Check out more here.