In addition to the penalty fixed by express terms for every neglect or violation of official duty on the part of public officers of the state, a county, city, town, district or township where it is not so expressly provided, such officers may, in the discretion of the court, be removed from office.