Moneys deposited by the state treasurer, or to his credit and standing to his credit at the expiration of his office, shall be carried to the account of his successor in office. The banks in which such deposits are held, shall, upon the production to them of a certificate from the secretary of state of the appointment of such successor in office, transfer such accounts accordingly.