§ 4. Removal of appointive officers in cities of the third class. No officer heretofore or hereafter appointed by the mayor of a city of the third class, or nominated and appointed by such mayor by or with the consent of the common council of such city, shall be removed or suspended from office without the approval of such mayor, such approval to be in writing and filed with the city clerk.