All bonds required and given in the administration of estate, testate and intestate, and the bond or bonds of the county administrator shall be recorded in the office of the clerk of the chancery court of the county, in a book kept for that purpose, and may be put in suit by any person injured by a breach thereof, he being responsible for costs. Any such bond shall not be void upon the first recovery, but may be sued on from time to time until the whole penalty shall have been recovered. When the whole penalty shall be recovered, the chancery court shall apportion the recovery, according to the rights of parties.