Whenever a vacancy happens in the office of sheriff, the deputies in office shall continue to execute all official business previously committed to such sheriff, in the name of the late sheriff until another is appointed and qualified, and until they have completed all business previously entrusted to them.