The executive and administrative officials and departments herein provided for shall establish their principal offices and keep all necessary public records, books and papers at the City of Jefferson.