Section 28. The clerk of each city or town shall provide therein a place for the safe keeping of the ballot boxes and counting apparatus furnished by the commonwealth, and of voting machines used in such city or town. He shall have the care and custody thereof, and see that they are kept in good order and repair. The custody, care and repair of all such voting machines, ballot boxes and apparatus shall be at the expense of the city or town, but shall be subject to the supervision and control of the state secretary, who may, at the expense of the commonwealth, subject to approval as provided in section thirty-two, cause necessary improvements to be made in any of such voting machines, ballot boxes or apparatus.