From Words to Worlds