Uncertainties are the most significant challenges in the smart power system, necessitating the use of precise techniques to deal with them properly. Such problems could be effectively solved using a probabilistic optimization strategy. It is further divided into stochastic, robust, distributionally robust, and chance-constrained optimizations. The topics of probabilistic optimization in smart power systems are covered in this review paper. In order to account for uncertainty in optimization processes, stochastic optimization is essential. Robust optimization is the most advanced approach to optimize a system under uncertainty, in which a deterministic, set-based uncertainty model is used instead of a stochastic one. The computational complexity of stochastic programming and the conservativeness of robust optimization are both reduced by distributionally robust optimization.Chance constrained algorithms help in solving the constraints optimization problems, where finite probability get violated. This review paper discusses microgrid and home energy management, demand-side management, unit commitment, microgrid integration, and economic dispatch as examples of applications of these techniques in smart power systems. Probabilistic mathematical models of different scenarios, for which deterministic approaches have been used in the literature, are also presented. Future research directions in a variety of smart power system domains are also presented.