Any retirement allowance payable in accordance with this part shall not be due or payable, however, during any period of time that a former governor is holding any public office, elective or appointive, or is otherwise on the payroll of the federal government or any state or local government.