How to Succeed in an Ensemble