A Minimalist Approach to Scrambling