Reductions Without Regret: Avoiding Box Canyons, Roach Motels and Wrong Turns