A person building a fence may lay the same upon the line between his own land and the land adjacent, so that the fence may be partly on one side of such line and partly on the other; and the owner shall have the same right to remove it as if it were wholly on his own land.