The attorney general shall appear for the State personally or by deputy, in all the courts of record, in all cases criminal or civil in which the State may be a party, or be interested, and may in like manner appear in the district courts in such cases.