The displacement tracking performance of the electro-hydraulic servo actuator is critical for hydraulic active suspension control. To tackle the problem of slow time-varying parameters in the existing actuator dynamics model, a nonlinear adaptive back-stepping control (ABC) approach is adopted. Simultaneously, the parameters of the nonlinear ABC are difficult to configure, resulting in a poor control effect. An enhanced particle swarm optimization (PSO) approach integrating crazy particles (CP) and time-varying acceleration coefficients (TVAC) is suggested to optimize the controller settings. Furthermore, in order to obtain satisfactory dynamic characteristics of the transition process, the absolute value of the error time integral performance index is used as the minimum performance index function of parameter selection, and the square term of the control input is added to the performance index function to prevent excessive controller energy. Finally, it can be observed from the simulation results of the highest value emax of the displacement tracking error, the average value eμ of error, and the standard deviation eσ of error that the performance of the ABC parameters optimized by PSO+CP+ATVC is superior to the manually given ABC parameters. Therefore, this control method significantly improves the stability and speed of the control system. It provides a new research idea for the parameter optimization of controllers.