Search results

Change body hashing method from SHA512 to Simhash

enhancementNew feature or requestNew feature or request

Status: Open.

#32 In benjaminestes/crawl;

· cstrouse opened on Nov 18, 2019

Add example config generation command

enhancementNew feature or requestNew feature or request

Status: Open.

#25 In benjaminestes/crawl;

· benjaminestes opened on Jul 25, 2019

Sitemap crawling should respect robots.txt

bugSomething isn't workingSomething isn't working

Status: Open.

#23 In benjaminestes/crawl;

· benjaminestes opened on Apr 29, 2019

SQL for hreflang report should ensure hreflang attribute has a value

Status: Open.

#22 In benjaminestes/crawl;

· benjaminestes opened on Mar 28, 2019

Update README with clearer installation instructions

Status: Open.

#20 In benjaminestes/crawl;

· benjaminestes opened on Jan 21, 2019

Call out and expand example analysis files

enhancementNew feature or requestNew feature or request

Status: Open.

#19 In benjaminestes/crawl;

· benjaminestes opened on Oct 18, 2018

Handle Config errors with great messages

enhancementNew feature or requestNew feature or request

Status: Open.

#15 In benjaminestes/crawl;

· benjaminestes opened on Oct 15, 2018

Implement capture (custom scraping)

enhancementNew feature or requestNew feature or request

Status: Open.

#5 In benjaminestes/crawl;

· benjaminestes opened on Aug 22, 2018