It shall be lawful to include in any contract hereinafter executed by or on behalf of the State, or any department or agency thereof or by or on behalf of any county, municipal corporation, or other division of the State, a provision that any matter in dispute arising under the said contract shall be submitted to arbitration in accordance with this chapter or such sections thereof as may be set forth in such contract, except as provided in § 5725 of this title.