Read more: The Only 6 Cleaning Supplies You Really Need, According To An Expert During a boil water advisory, it's generally considered okay to shower and bathe in unboiled tap water, but use caution ...