The Governor shall appoint every person who is appointed to the office of justice of the peace and as Secretary of Finance also as a notary public. The Secretary of Finance shall only act as a notary public in connection with work performed in carrying out the duties of the office. The notary commission of any person appointed a notary public under this section shall terminate at the same time such person's term of office terminates.