Solid oxide cells (SOCs) are a promising dual-mode technology that generates hydrogen through high-temperature water electrolysis and generates power through a fuel cell reaction that consumes hydrogen. Reversible operation of SOCs requires a transition between these two modes for hydrogen production setpoints as the demand and price of electricity fluctuate. Moreover, a well-functioning control system is important to avoid cell degradation during mode-switching operation. In this work, we apply nonlinear model predictive control (NMPC) to an SOC module and supporting equipment and compare NMPC performance to classical proportional integral (PI) control strategies, while ramping between the modes of hydrogen and power production. While both control methods provide similar performance in many metrics, NMPC significantly reduces cell thermal gradients and curvatures (mixed spatial temporal partial derivatives) during mode switching. A dynamic process flowsheet of the reversible SOC system was developed in the open-source, equation-based IDAES modeling framework. Our IDAES dynamic simulation results show that NMPC can ramp the SOC system between hydrogen and power production targets within short mode switching times. Moreover, NMPC can comply with operating limits in the SOC system more effectively than PI, and only NMPC can directly enforce user-specified limits for mixed spatial temporal partial derivatives of temperature. This allows for management of the trade-off between operating efficiency and cell degradation, which is dependent on these temperature curvatures.