Actual construction, except under applications by a city or town for municipal uses, shall begin within two years after approval of the application, and shall be prosecuted with reasonable diligence and completed within a reasonable time which shall be fixed in the permit at not to exceed five years from the date of approval. The director shall, for good cause shown, extend the time beyond the five-year period if the magnitude, physical difficulties and cost of the work justify extension.