This is an automated archive made by the Lemmit Bot.

The original was posted on /r/talesfromtechsupport by /u/Ok_Pomelo_2685 on 2025-09-11 23:24:52+00:00.


It was a Saturday, as it always is when these things happen, and I was about to take my daughter to the pool when I get a call from my boss. He tells me the sprinkler pipe burst in our data center right over our storage rack. I thought he was joking. I head right to work as-is, dressed ready to go to the pool. I get onsite and there is a small group of IT and maintenance co-workers in the closet. The water was turned off by the time I arrived, but it was too late. One of our NetApp shelves got filled with water. We pulled the shelf and emptied about two gallons of water into the garbage can. One of the maintenance guys says “I know how we can dry out the shelf” and off to the boiler room we went. After letting the shelf sit there for two hours, we slid it back into the rack and it fired up like nothing happened. No disks were lost, NetApp support validated the entire system, and we started validating all of our VMs. I never did make it to the pool that day.