In each county wherein all taxes and licenses levied for any one year exceed two million dollars, the collector shall keep a notary public in his office at all times, who shall administer oaths and take notarial acknowledgments in connection with the office without charge.