The property so taken, and also like property of the district to which the special district is united, shall be appraised by the selectmen of the town, and at the next annual assessment a tax shall be levied upon the whole town district equal to the amount of the whole appraisal; and there shall be remitted to the taxpayers of each district the appraised value of its property.