The Prudential Committee shall consist of five persons, and at the annual meeting of the District, vacancies occasioned by the expiration of the term of office of members of the Committee shall be filled by the election of members for the term of three years each; and all vacancies on the Committee caused by resignation, death, removal from the District, or other cause shall be filled at an annual or special meeting warned for that purpose for the unexpired term of such members only.