Due to the complex formation process of a rock mass, a large number of fissures, joints, faults, other defects exist and the defects commonly contain infilled materials. The jointed rock masses are in a complex geological environment, in which the geometric distribution and the boundary condition can greatly affect the mechanical behavior of the infilled jointed rock mass. In this study, the infilled jointed rock mass specimens with different dip angles are prepared using similar materials, and the uniaxial and biaxial compression tests on the specimens are conducted. The effect of the joint dip angle on the mechanical behavior of the infilled jointed rock mass under uniaxial and biaxial compressions is investigated. The results show that the uniaxial compressive strength shows a W-shaped variation, and the biaxial compressive strength shows a V-shaped variation with an increase in the dip angle. Most of the cracks appear in pairs around the joint and occur symmetrically in a bilateral distribution, and the existence of the infilled joints induces a nonlinear mechanical behavior in the specimen. In addition, the specimens exhibit three failure modes under uniaxial compression: splitting failure, step-path failure and planar failure. The specimens present two failure modes under biaxial compression: splitting failure and planar failure.