Traditional classification method based on machine learning algorithm has been widely adopted in very high resolution remote sensing image classification, yet the problem that could not effectively convey a higher level of abstract feature still need to be improved. This paper, relying on the convolution neural network algorithm, has conducted on the high-resolution remote sensing image classification method. Firstly, structure of convolution neural networks was analyzed. The prediction model of convolution neural networks was discussed, and the core of structure was the alternation of the convolution layer and the down sampling layer. Then, the training model of convolution neural networks was researched. By using weights sharing and local connection, convolution neural network, that image could directly entered into, avoids to a certain extent caused by image displacement, dimension change and so on. On this basis, basing on different phase GF-1 remote sensing data and MATLAB development environment under Windows10 operating system, then combining with object-oriented classification technology in image segmentation, this paper built the high resolution remote sensing image classification model based on convolution neural network. Finally, the parameters of the model were tested and analyzed repeatedly, and more accurate model parameters were obtained in this paper. Results show that the mode can effectively improve the classification accuracy, and provide technical support for improving remote sensing image interpretation and formulating sustainable development strategy.