From Number Theory to Physics