Section 5.  A member of the state or of a city civil service commission may be removed by the governor or the governing authority, as the case may be, for cause, after being served with written specifications of the charges against him and being afforded an opportunity for a public hearing thereon by the appointing authority.