Any person so erecting or continuing any building, structure or fence, so as to interfere with, hinder or obstruct the public travel, shall be guilty of a violation, and the superior court may order such building, structure or fence to be removed, if it be found that the same does so obstruct or lessen the full breadth of the highway, or is dangerous to public travel thereon.