An action to annul the marriage on the ground of physical incapacity of one of the parties at the time of marriage, shall only be maintained by the injured party, against the party whose incapacity is alleged, and shall in all cases be brought within two years from the solemnization of the marriage.