Upon the selection of any county depository, either upon bids therefor or by designation of the board of supervisors or the Commissioner of Banking and Consumer Finance, and such designated financial institution becoming qualified as required by law, the tax collector of such county or counties shall deposit all funds collected therein and thereafter make a transfer to the several accounts and funds as now required by law of him in making his settlements. Upon so depositing such funds when collected, the tax collector shall thereupon be relieved and discharged from further liability therefor excepting for such amounts as the tax collector may withdraw or cause to be withdrawn from his account or accounts and to which he is not legally entitled.