This article provides plain and handy expressions to decide the most suitable analytical model for the thermal analysis of the ground source in vertical ground-coupled heat pump applications. We perform a comprehensive dimensionless analysis of the reciprocal deviation among the classical infinite, finite, linear and cylindrical heat source models in purely conductive media. Besides, we complete the framework of possible boreholes model with the “hollow” finite cylindrical heat source solution, still lacking in the literature. Analytical expressions are effective tools for both design and performance assessment: they are able to provide practical and general indications on the thermal behavior of the ground with an advantageous tradeoff between calculation efforts and solution accuracy. This notwithstanding, their applicability to any specific case is always subjected to the coherence of the model assumptions, also in terms of length and time scales, with the specific case of interest. We propose several dimensionless criteria to evaluate when one model is practically equivalent to another one and handy maps that can be used for both design and performance analysis. Finally, we found that the finite line source represents the most suitable model for borehole heat exchangers (BHEs), as it is applicable to a wide range of space and time scales, practically providing the same results of more complex models.