No building shall be moved until a permit has been obtained from the inspector, and such official shall not issue such a permit if in his judgment the proposed new location of the building would seriously increase the fire hazard of the surrounding buildings.