This paper is a literature review of articles on implementation of Enterprise Resource Planning (ERP) in public sector with a focus on developing countries. The aim of the paper is to present an in depth understanding of the implementation of ERP systems in developing countries public sector. It intends to help researchers interested in the topic to have a single source of reference, and to understand the state of ERP implementation in developing countries public sector. A systematic literature review methodology was adopted for an in-depth review of journals, conference proceedings and reviews. The review covered a range from 1998 to 2018; 72 were related to public sector. Developing countries contribute only 5% to the ERP research in public sector. The major themes identified include genesis of ERP, implementing ERP, CSF for implementing ERP, ERP implementing frameworks/methodologies, impact of ERP on Business Processes, ERP market, ERP cost and failure, and ERP trends. Findings on each theme are discussed. Areas are recommended that need to be understood in context of developing countries public sector; external and internal opposing factors, specific CSF/CFF, ERP implementing framework/methodologies, Total Cost of Ownership, ERP integration and ERP framework/architecture to ensure successful implementation of ERP and reduce cost.