Staying Safe at Every Step