Permits may be granted without hearing by the Department of Consumer Protection in its discretion; but, in any case of the denial of or refusal to renew a permit, the department shall, in such manner as it directs, notify the applicant or permittee of its proposed action and set a day and place for a hearing thereon, giving the applicant or permittee reasonable notice in advance thereof. If, at or after such hearing, the department denies or refuses to renew the permit, as the case may be, notice of such decision shall forthwith be given to such applicant or permittee in such manner as the department directs.