All registers, returns and other documents relating to the affairs of the penitentiary are public documents and shall remain in the penitentiary. The warden shall preserve official copies of the warden’s correspondence with the governor, commissioner of correction or other public officers and of any official communication the warden may receive from them.