Playing to Learn with Reacting to the Past