Prosecutions for offences under the provisions of this act and for violation of the provisions of any by-laws of said Village made in pursuance of this act may be commenced on complaint of any police officer of said Village or any grand juror of the Town of Ludlow before any justice of the peace in said County of Windsor, and all fines and costs imposed for the violation of any of the provisions of this act or the violation of any of the bylaws of said Village or the laws of the State within the limits of said Village, shall be paid into the treasury of said Village. And the costs of prosecution shall be paid out of the same treasury to the persons entitled thereto on the order of the justice of the peace before whom the trial was held.