Nothing in this chapter shall be construed to prohibit appeals to a court of competent jurisdiction by persons aggrieved by a decision of the Secretary under § 2119 of this title. Such an appeal shall be on the record and confined to a determination as to whether the Secretary abused his or her discretion, provided that no appeal shall stay an order by the Department.