The sheriff of each county may appoint not more than three suitable women residents of the county as matrons of the county jail, who shall hold office during the pleasure of the sheriff and whose compensation shall be fixed by the board of chosen freeholders of the county and be paid semimonthly by the county.