Each court of record having jurisdiction of criminal cases upon good cause shown by either party may change the venue in any cause pending therein, and direct the issue to be tried in the circuit court of another county, and make all necessary rules and orders for the certifying and removing such cause, and all matters relating thereto, to the court in which such issue shall be ordered to be tried, and the court to which such cause shall be so removed shall proceed to hear, try and determine the same, and execution may thereupon be had in the same manner as if the same had been prosecuted in the court having original jurisdiction of such cause, except that in all causes when the defendant shall be convicted and be sentenced to imprisonment in the county jail or to pay a fine, or to both such imprisonment and fine, the court awarding such sentence shall have authority to direct and shall direct that the defendant be imprisoned in the county jail of the county in which such prosecution commenced; and that such fine, when paid, shall be paid over to the county treasurer of the county in which such prosecution commenced, in the same manner as is now provided by law for paying over fines to county treasurers; and in every case where a change of venue is ordered, all expenses of such trial shall be a charge upon the county in which the prosecution originated; and when there shall be a disagreement of the jury on the trial of any criminal cause in the circuit court to which such cause was ordered for trial, the circuit judge before whom the same was tried, if he shall deem that the public good requires the same, may, upon cause shown by either party, order and direct the issue to be tried in the circuit court of another county in the state; and the court to which such cause shall be removed shall proceed to hear, try and determine the same in the same manner and with like effect as was pursued by the circuit court making such order: Provided, That in any and all suits, proceedings, causes or actions now pending in any of the circuit courts of this state, whether the court has general or special jurisdiction, a change of venue may be had in the manner provided and in accordance with section 10 of Act No. 157 of the Public Acts of 1851, as amended by Act No. 309 of the Public Acts of 1905 and the provisions of said act shall be continued in full force and effect for such purpose: Provided further, That in all suits, proceedings, causes or actions in which a change of venue has been granted, the court to which such suit, proceeding, cause or action has been transferred, shall retain jurisdiction.