Each depository bond shall provide that during the time the bond is in force, the depository will pay all the governmental funds deposited with it to the Commissioner of Finance or other authorized officer, free of exchange, at any place in the Virgin Islands designated by him. If the deposit is a time deposit, it shall be paid, together with interest, only when due. The Commissioner of Finance may require a new or additional bond from any depository at any time.