Scatter, Adapt, and Remember