The state controller may deliver to the clerk of each district court, to wardens, and to the clerks of the superior court, except the clerk of the superior court in the county of Providence, orders for fees of officers and witnesses in criminal prosecutions allowed by the courts, and by the controller found to be due to the officers and witnesses from the state; and the justices, wardens, and clerks, upon application therefor, shall deliver the orders to the officers and witnesses entitled to them.