Stationary battery systems are becoming increasingly common worldwide. Energy storage is a key technology in facilitating renewable energy market penetration and battery energy storage systems have seen considerable investment for this purpose. Large battery installations such as energy storage systems and uninterruptible power supplies can generate substantial heat in operation, and while this is well understood, the thermal management systems that currently exist have not kept pace with stationary battery installation development. Stationary batteries operating at elevated temperatures experience a range of deleterious effects and, in some cases, serious safety concerns can arise. Optimal thermal management prioritizes safety and balances costs between the cooling system and battery degradation due to thermal effects. Electric vehicle battery thermal management has undergone significant development in the past decade while stationary battery thermal management has remained mostly stagnant, relying on the use of active and passive air cooling. Despite being the default method for thermal management, there is an absence of justifying research or comparative reviews. This literature review seeks to define the role of stationary battery systems in modern power applications, the effects that heat generation and temperature have on the performance of these systems, thermal management methods, and future areas of study.