The Governor’s spouse shall remain on the Governor’s Residence Advisory Commission as chairperson during the time his or her spouse is Governor, but in the case of an at-large member appointed in place of the Governor’s spouse, the at-large member shall serve at the pleasure of the Governor. The agency directors and task force administrator on the commission shall serve as long as such persons hold those positions. The remaining members of the commission shall serve four-year terms, subject to removal by the Governor for cause. Vacancies on the commission caused by the death, removal, or resignation of a member shall be filled by the Governor for the remainder of the unexpired term.