All such fences shall be removed within the time designated, and, if not removed by the date stated in such notice, they may be forthwith removed by said department at the expense of the owner.