Skip to content

Conversation

@nithitsuki
Copy link
Contributor

Summary

  • Swapped the favicon pipeline to rely on Google’s service as the primary source
  • Added DuckDuckGo as a secondary fallback service to cover sites that still miss icons

P.S use --force to refresh cache

- Use Google favicon service as primary source (faster, more reliable)
- Add cache support: skip re-fetching existing favicons
- Add --force flag to bypass cache when needed
- Store failed lookups as null in manifest to avoid retrying
- Reduce timeout from 10s to 8s
- Simplify fetch strategy (fewer HTTP requests per site)
- Change output extension to .ico to match actual content
@heftymouse
Copy link
Contributor

heftymouse commented Jan 28, 2026

Is there a reason to use the api over the direct one?

@nithitsuki
Copy link
Contributor Author

nithitsuki commented Jan 28, 2026

yes, It seems to be able to fetch the favicons for the 4 missing websites. Specifically: Ajay, Archishman, Chirayu and Noel

@nithitsuki
Copy link
Contributor Author

removed caching, and also fetches .svg .png favicons if found
works for 100% of the websites which have a favicon

also maybe we should open an Issue to rework the favicon fetching logic with bun's HTMLRewriter logic for future reference?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants