From the date of the deposit, which shall be evidenced by the bank book, the county trustee shall be released from liability for losses to the county in consequence of the contract and deposit; but should the county trustee fail or refuse specifically to obey the order specified in § 5-8-203, the county trustee shall be held liable not only for the money collected and not so deposited, but for the interest on the funds mentioned in the contract, and as a penalty shall be liable for further interest equal in amount of the interest contracted for, all of which may be recovered by suit; and when collected the interest paid as penalty shall become the property of the contracting bank or banks, and the balance of the fund recovered, together with the cost, shall be paid to the county.