Rocks are natural heterogeneous materials. It is common for a rock to have several kinds of minerals, which will have a significant effect on its mechanical behavior. The purpose of the numerical simulation study in this paper is to explore the effects of minerals on the crack patterns and mechanical properties of rocks. First, the corresponding calculation model is established by using the discrete element method (DEM), whereby the mechanical parameters of the blocks and joints in the Tyson polygon procedure are fitted with the rock properties obtained in the laboratory. Then, various combination models of different mineral sizes and ratios are established to study the effects of mineral size, position, and ratio on the fracture distribution and mechanical properties of rock samples. The results indicate that with increased circle size of the center mineral and the mineral ratio, the elastic modulus and uniaxial compression strength (UCS) of the model gradually increase. The drop degree of post-peak stress decreases, and the integrity and bearing capacity increase. It is found that there is a quartic polynomial relationship between elastic modulus and mineral circle radius, with R2 ≥ 0.94. The minerals located in the crack propagation path will effectively block the crack and change the propagation direction. When the mineral position is close to the model boundaries, especially the lateral boundaries, it has a significant influence on the crack initiation position, causing crack initiation to occur at the upper boundary of the mineral circle and propagate to the middle of the model. With increased mineral percentage and small-size mineral circle proportion, the depth of extension of the crack from boundary to center is reduced, the crack has wide development in the boundary area, the number of central cracks in the rock specimen decreases, and the degree of fragmentation decreases.