Fluctuation Theorems under Divergent Entropy Production and their Applications for Fundamental Problems in Statistical Physics