Getting the Most from Supervision