Whenever the attorney general is authorized under this chapter to prosecute a criminal proceeding on behalf of the department, such authority may in the discretion of the attorney general be delegated to the department, to initiate or conduct any such prosecution. Provided, however, that in any event the district attorney of the county in which the violation occurs may initiate or conduct any such prosecution.