It shall be the duty of every public administrator immediately upon taking charge of any estate, except those of which he shall have taken charge under the order of the court, for the purpose of administering the same, to file a notice of the fact in the office of the clerk of the court. If any public administrator shall fail to file the notice provided for in this section, he shall forfeit and pay to the persons entitled to the estate a sum not exceeding two hundred dollars, to be recovered before said court, on motion, and after reasonable notice thereof to said public administrator; and said court may, in its discretion, remove such public administrator from office.