A person building a fence may erect the same upon the line between him and the adjacent owners, so that the fence may be partly on one side and partly on the other, and the owner of such fence shall have the same right to remove it as if it were wholly on his land: Provided, that such fence is not more than five (5) feet from such line.
R.L. 1910, § 170.