The judge of probate, the tax assessor, the tax collector, the sheriff, and the county treasurer or custodian must be allowed reasonable expenses for suitable books, stationery, postage stamps used exclusively for official business, and telephones, to be paid for by the county on the approval of the county commission, and the judge of probate shall also be allowed expense for his seal of office, to be paid for by the county.