Calcite cement is a common type of cementation in tight sandstone reservoirs of the Upper Triassic Yanchang Formation Chang 8 Member in the Zhijing-Ansai area of the Ordos Basin, which has significant influence on reservoir densification and heterogeneity. Calcite cements affect the quality of the reservoir conspicuously. The characteristics and origins of calcite were investigated using a series of approaches from the perspective of petrography and geochemistry, including thin section observation and identification, cathode luminescence, scanning electron microscopy, AMICS analysis, LA-ICP-MS elements analysis, and carbon and oxygen isotopes analysis. The results of all analytical tests indicated that calcite cements can be divided into two types according to their occurrence and origins. Type-I calcite cements mainly occur in sandstone reservoirs near the sandstone−mudstone interface or the sandstone layers adjacent to mudstone. Generally, there is no chlorite coating around them, and they appear dark orange under cathode luminescence. The carbon source of Type-I calcite cements may be related to the compaction and drainage of mudstone. Type-II calcite cements are formed in the early stage, and their carbon source may be related to the compaction and drainage of the adjacent mudstone. Type-II calcite cements are surrounded by chlorite coating primarily present in the interior of fine-grained sandstone, showing as bright yellow under cathode luminescence. Decarboxylation of organic matter in the source rocks may provide a crucial source of carbon for Type-II calcite cements.