The parties jointly shall pay for the stenographic record. A copy of the record shall be furnished by the parties to the arbitrator and shall be forwarded by him to the Administrator, ultimately to be filed in the office of the hearing clerk. The arbitrator shall not receive compensation for parties to the dispute.