If the clerk or other officer who takes the probate or acknowledgment of a deed or other instrument fails or refuses to comply with and discharge the duties required of the clerk or officer, the clerk or officer shall forfeit and pay the sum of one hundred dollars ($100) for the use of the county in which the clerk or officer resides, which may be recovered by action of debt, in the name of the trustee of the county, in the circuit or chancery court; and the clerk or officer shall, moreover, be liable to the party injured for all damages the clerk or officer may sustain by such failure or refusal, together with costs, to be recovered by action on the case in the circuit or chancery court.