The Department of Banking and Consumer Finance is hereby created, and it is solely charged with the execution of all laws relating to corporations, carrying on a banking business in the State of Mississippi. The office of the Department of Banking and Consumer Finance shall be in the City of Jackson, Mississippi, and the Secretary of State shall provide suitable quarters therefor.