Due to the increasing penetration of distributed generations (DGS) and non-negligible grid impedance, the instability problem of the multi-inverter system operating in current source mode (CSM) is becoming serious. In this paper, a closed-loop transfer function model of such a multi-inverter system is established, by which it is concluded that output current resonance will occur with the increase in the grid impedance. In order to address this problem, this paper presents a novel dual-mode control scheme of multiple inverters: one inverter operating in CSM will be alternated into voltage source mode (VSM) if the grid impedance is high. It is theoretically proved that the coupling between the inverters and the resonance in the output current can be suppressed effectively with the proposed scheme. Finally, the validity of the proposed theory is demonstrated by extensive simulations and experiments.