§ 124. Suspension and removal of official referees. Any official referee continued in office and serving under the provisions of this article, as amended, except an official referee of the court of appeals, may be suspended or removed by the justices of the appellate division in the department in which the appointment was made.