The Department shall occupy a suitable and convenient office in the courthouse or public building of each county, or elsewhere in the county seat of each county, and shall obtain whatever furniture, equipment and supplies that may be necessary to properly carry out its duties.