The Governor is hereby empowered, in accordance with the provisions of Section 139 of the Mississippi Constitution of 1890, through the procedure and under the regulations prescribed in Sections 25-5-3 through 25-5-37 and for the reasons and causes set forth, to remove any elective county officer in this state; and every elective officer of any county in this state may be removed from office by the Governor at any time when done in compliance with the regulations hereinafter set forth.