Failure to begin work under a permit within 6 months after it is granted, or failure to diligently prosecute such work after it has been begun, shall make the permit void without any order or proceeding by the Secretary having jurisdiction.