Whenever any recognizance, stipulation, bond or undertaking, conditioned for the faithful performance of any duty or for doing or refraining from doing anything in such recognizance, stipulation, bond or undertaking specified, is, by the laws of this state, required or permitted to be given with one surety or with two or more sureties, the execution of the same, or the guaranteeing of the performance of the conditions thereof, shall be sufficient when executed or guaranteed solely by a corporation duly organized and existing under the laws of this state, or of any state of the United States, having a paid-up capital of not less than one hundred thousand dollars and having power under its charter to guarantee or insure the fidelity of persons holding places of public and private trust, to become surety on bonds and obligations of persons and corporations, and to become surety on any bond, recognizance or other writing in the nature of a bond, in the same manner that natural persons may, subject to all the rights and liabilities of such persons; Provided, such corporation is approved as surety upon such recognizance, stipulation, bond or undertaking by the head of the department, court, judge, officer, board or body executive, legislative or judicial, required or authorized to approve or accept the same.