An Analysis of the Effects of Contextual Representation