Create a short design document for the test application that we will implement. Include the following:
- What kinds of information / metrics will it need to display
- How will it interact with Scrapy
- A very high level architecture of the system
- What kinds of options / settings will be needed? (i.e. maybe a source / destination directory for where the uncompressed test data will come from and where it will land-post-compression)
Create a short design document for the test application that we will implement. Include the following: