Appeals to the board of appeals may be taken by any person aggrieved, or by any officer, department or board of the county affected, by any grant or withholding of a building permit or by any other decision of a building commissioner or other administrative official, based in whole or in part upon any ordinance under this part.