The commissioner or board at the head of each department herein specified is empowered to prescribe and to enforce rules and regulations, subject to the approval of the Governor, for the government and administration of such department, the conduct of its employees and the custody, use, and preservation of the records, books, documents, and property pertaining thereto.