Any merit system officer or employee to whom the mayor, or a head of any office, department, or agency, may appoint a successor, may be removed by the mayor or other appointing officer at any time, and the decision of the mayor, or other appointing officer, shall be subject to appeals provided by law.