A board member shall be removed from office by the governor for malfeasance, willful neglect of duty, or other cause after notice and public hearing, unless such notice or hearing shall be expressly waived in writing.