Coffee is one of the most popular beverages worldwide. Its effect on health is generally regarded as beneficial in many studies. However, there are growing concerns about the adverse effect of coffee consumption on cardiovascular disease (CVD) due to the potential aggravating impact on the cardiovascular system attributed to various compounds within coffee. This review is focused on deteriorative effects of coffee consumption on CVDs with possible mechanisms. Patients with risk factors of CVDs should prudently consider heavy consumption of coffee as it may exacerbate hypertension, dyslipidemia, and atherosclerosis, and increase the odds of cardiovascular events. J-shaped or U-shaped dose-response graphs of coffee consumption and CVD parameters partially explain the inconsistency of conclusions between coffee studies on CVD, highlighting a moderate intake of coffee. Moreover, there are discrepancies in results from clinical studies elucidating considerable influences of confounding factors including gender and smoking status on outcomes of those conducted to reveal the actual impact of coffee consumption on CVDs. Physical features of subjects including genetic variations and body mass index (BMI) make it difficult to determine moderate intake of coffee for individuals in terms of caffeine metabolism. Further epidemiological studies with consideration about characteristics of the study population are needed to determine the exact effect of coffee consumption on CVD.