Should You Judge This Book by Its Cover?