Members of any governing board of public higher education shall be subject to removal from the board for neglect of duty. The governor may petition for a board member’s removal due to neglect of duty and the removal shall be effective upon a majority vote of the voting board members.