The governor shall remove any member of the board whose license has been revoked or suspended. The governor may, after hearing, remove any member for neglect of duty or other just cause.