The use of solar photovoltaic systems in green energy harvesting has increased greatly in the last few years. Fossil fuels reaching the end are also growing rapidly at the same rate. Despite the fact that solar energy is renewable and more efficient, it still needs regular Inspection and maintenance for maximizing solar modules’ lifetime, reducing energy leakage, and protecting the environment. Our research proposes the use of infrared radiation (IR) cameras and convolution neural networks as an efficient way for detecting and categorizing anomaly solar modules. The IR cameras were able to detect the temperature distribution on the solar modules remotely, and the convolution neural networks correctly predicted the anomaly modules and classified the anomaly types based on those predictions. A convolution neural network, based on a VGG-based neural network approach, was proposed in this study to accurately predict and classify anomalous solar modules from IR images. The proposed approach was trained using IR images of solar modules with 5000 images of generated solar panel images. The experimental results indicated that the proposed model can correctly predict an anomaly module by 99% on average. Since it can be costly and time-consuming to collect real images containing hotspots, the model is trained with generated images rather than real images. A generated image can be used more efficiently and can also have custom features added to it. In the prediction process, the real image is processed and it is sent to the model to determine bounding boxes. It provides a more accurate prediction than direct use of the real image. Here we have used CNN custom model and TensorFlow libraries.