In this paper, an efficient ontology integration model for cooperative agent framework is proposed. Context aware computing with inference based on ontology investigates distributed entities on surveillance devices such as smart cameras or sensors which may carry heterogeneous data. However, even smart devices have small memory and power capacities which can only manage a portion of the ontology data. In the proposed ontology integration model, each of the agents that are built into devices get services not only from a region server, but also from peer agents with proper access control and data management.