We investigate data-driven, simple-to-implement residential environmental models that can serve as the basis for energy saving algorithms in both retrofits and new designs of residential buildings. Despite the nonlinearity of the underlying dynamics, using Koopman operator theory framework in this study we show that a linear second order model embedding, that captures the physics that occur inside a single or multi zone space does well when compared with data simulated using EnergyPlus. This class of models has low complexity. We show that their parameters have physical significance for the large-scale dynamics of a building and are correlated to concepts such as the thermal mass. We investigate consequences of changing the thermal mass on the energy behavior of a building system and provide best practice design suggestions.