This is a simple python script, you change the last two lines for the url you want it to spider and the folder you want the files deposited in. The Spider will go 3 levels deep and it will find txt, zip, pdf and html files.If there is a link menu on the page, it will follow the links down.
This script is simple but effective for scouring Prepper files and loading them on your computer or memory stick.
NOTE : This tool must be run from the python3 command line
Change the url to match the url you want it to scour.
Change the folder path you want it to save the files to
type : python3 spidertrap.py
It will start displaying the file count in the console window.