OpenWebScraper 0.7.0 beta

New beta release for OpenWebScraper.

New features:

• Paragraph crawl analyzer module
  • Analyze your crawl data while it is still running or after it has finished (count paragraphs/words)
  • Also analyzes logs, counts all warnings and by type (for most common warnings)

Fixes:

• Saving crawl specification without starting a crawl only saves valid urls now (#12)

Recommended with OWS-Scrapy-Wrapper 0.4.2 beta

OpenWebScraper 0.6.1 beta

New beta release for OpenWebScraper

Improvements:

• Better integration of scrapy-wrapper link
• Improved settings handling

Recommended with OWS-Scrapy-Wrapper 0.4.1 beta

OpenWebScraper 0.6.0 beta

Another pre-release of the OpenWebScraper Scrapy Frontend.
New features:

• Separate whitelist configuration
• Better language detection options
• Raw Content parsing, store those scraped pages as raw as they come!

Recommended with OWS-scrapy-wrapper 0.3.1 beta

OpenWebScraper 0.5.0 beta

This is the first beta-release of the OpenWebScraper.
Features:

• Crawler module
  • Configure and initialize local web-crawls with OWS-scrapy-wrapper
• Template module
  • Used to preview code structure of a UI module