Secular Evolution of Self-Gravitating Systems Over Cosmic Age