It shall not be lawful for the court reporter to resign or vacate his office so long as any business connected therewith, upon the discharge of which he has entered, is unfinished; but after such business has been completed as required by law, he may at any time resign or vacate his office; and his resignation shall take effect from the time he notifies the judge or chancellor of the same.