When Colorblindness Isn't the Answer