All violations of ordinances or bylaws may be prosecuted in behalf of the Town by its attorney, or police officers, or by any other duly authorized prosecuting officer, before the Caledonia Municipal Court; and all fines, penalties, or forfeitures recovered by the said Town for violations of such ordinances or bylaws shall be paid into the Town Treasury.