When any of the sureties of any officer elected or appointed to any office shall, in writing, notify the proper officer whose duty it is to approve the bond of such officer that they desire to be relieved from their suretyship, the officer authorized by law to approve such bond shall require the officer to execute a new bond with surety, which, when approved, shall be as valid as the bond given on the original election of appointment of such officer. And the sureties upon the prior bond shall be released from responsibility for all acts or defaults of such officer which may be done or committed subsequent to the approval of such new bond.