Whenever it shall be credibly alleged to the governor that the state treasurer or any tax collector is a defaulter, the governor shall direct the examiner forthwith to examine the records, books, and accounts of such treasurer or tax collector and, as soon as practicable, to report the condition of such officer's accounts. If the report show such officer to be a defaulter or short in his accounts, the governor shall at once suspend him and appoint some other person to perform the duties of the office pending the investigation of his account.