site-archiving

Here are 2 public repositories matching this topic...

A fast, simple bash script for cloning websites using wget with rotating proxies and user agents.

scraper clone copy mirror proxies wget wget-utility mirroring web-archiving useragent web-archive website-clone useragent-switch clone-website archive-webpage site-archiving

Crawls and exports Classic Google Sites into a .docx file, preserving recipe titles and bullet lists. Written in Python.

Add a description, image, and links to the site-archiving topic page so that developers can more easily learn about it.

To associate your repository with the site-archiving topic, visit your repo's landing page and select "manage topics."