Search results

Decouple Docker builds to enable parallel builds

Status: Open.

#41 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

refactor: deduplicate Cypher queries in crawl_service.rs

kissKeep it simple stupidKeep it simple stupid

priority: lowNice to have improvementNice to have improvement

refactorCode refactoringCode refactoring

Status: Open.

#31 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

docs: add CONTRIBUTING.md and CODE_OF_CONDUCT.md

documentationImprovements or additions to documentationImprovements or additions to documentation

open-sourceOpen source community healthOpen source community health

priority: lowNice to have improvementNice to have improvement

Status: Open.

#30 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

feat: add gamification to the crawl and graph exploration experience

enhancementNew feature or requestNew feature or request

have-funPlayful theme and gamificationPlayful theme and gamification

priority: mediumShould address in near termShould address in near term

Status: Open.

#29 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

feat: implement cartoony cobweb theme per project vision

enhancementNew feature or requestNew feature or request

have-funPlayful theme and gamificationPlayful theme and gamification

priority: lowNice to have improvementNice to have improvement

Status: Open.

#28 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

feat: add docker-compose.yml for simple local deployment

enhancementNew feature or requestNew feature or request

kissKeep it simple stupidKeep it simple stupid

priority: lowNice to have improvementNice to have improvement

Status: Open.

#27 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

fix: update user-agent string to identify the crawler transparently

enhancementNew feature or requestNew feature or request

priority: mediumShould address in near termShould address in near term

respectful-crawlingRelated to respectful crawling principlesRelated to respectful crawling principles

Status: Open.

#25 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

feat: add configurable maximum URL cap per crawl

enhancementNew feature or requestNew feature or request

priority: highImportant for project vision alignmentImportant for project vision alignment

respectful-crawlingRelated to respectful crawling principlesRelated to respectful crawling principles

Status: Open.

#24 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

feat: add per-domain rate limiting to prevent abuse

enhancementNew feature or requestNew feature or request

priority: criticalMust fix - contradicts project visionMust fix - contradicts project vision

respectful-crawlingRelated to respectful crawling principlesRelated to respectful crawling principles

Status: Open.

#23 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

feat: implement robots.txt support for respectful crawling

enhancementNew feature or requestNew feature or request

priority: criticalMust fix - contradicts project visionMust fix - contradicts project vision

respectful-crawlingRelated to respectful crawling principlesRelated to respectful crawling principles

Status: Open.

#22 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 22, 2026

bug: Graph visualization clumps on large running crawls

Status: Open.

#21 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 15, 2026

bug: cancel operation is not durable — feeders overwrite CANCELLED status

Status: Open.

#20 In nabi-allenby/web-crawler;

· bluedotiya opened on Feb 15, 2026