Sheriffs, undersheriffs and deputies may execute and return all such writs and processes as shall be in their hands at the expiration of their office, or at the time of their removal from office, which they shall have begun to execute by service, levy or collection of money thereon.
R.L. 1910, § 1702.