As a result of any examination, or from any report made to him, if the supervisor finds that any association or any director, officer or employee of any association is violating the provisions of the charter or bylaws of the association, or the laws of this state or the United States or any lawful regulation promulgated by the supervisor, he shall deliver a formal written order to the board of directors of the association in which the facts known to the supervisor are set forth, demanding the discontinuance of the violation and conformance with all requirements of law. The association affected by the order may, within thirty days after the order has been delivered to the association, request a public or private hearing before the supervisor with regard to the order, at which hearing any pertinent evidence relating to the order or the facts stated therein may be presented. After the hearing, the supervisor, on the basis of the evidence presented, shall either continue the order in effect, modify it or set it aside. The hearing shall be on the record and the cost of a transcript of the hearing shall be paid by the association.