With Observation and Imagination