The money so raised and collected shall be expended in repairing class IV and class V highways by the agents elected or appointed for the purpose, under the direction of the selectmen.