In order to establish the effect regulation of surface topography characteristic parameters on gear dynamics performance,measurement of fractal dimension for gear surface and its efficiency and vibration are tested in the condition of different lubrication. Based on three sets of gearbox with the same tooth surface accuracy level,the tooth contour is measured in the cases of oil lubrication,grease lubrication and dry friction with the equal load and running time,and the corresponding fractal dimension is got by the methodology of structural function. The result shows that when it is oil lubrication,the fractal dimension is the largest and the variation ranges of fractal dimension is the smallest before and after the experiment,which indicates that the less tooth wear leads to more stable dynamic performance. Through the test of efficiency and vibration characteristics,it is found that the transmission efficiency is the highest and amplitude is lowest with oil lubrication,which is consistent with the analysis of fractal dimension. The research can provide theoretical basis and application prerequisite for the subsequent micro-topography design of tooth surface.