Skip to content

Job Sources: Expand beyond Greenhouse/Lever/HN #7

@madhavcodez

Description

@madhavcodez

Current State

SecretAIRY ingests from 3 sources with hardcoded company lists:

  • Greenhouse: 15 board tokens (Anthropic, OpenAI, Vercel, etc.)
  • Lever: 10 companies (Netflix, Coinbase, etc.)
  • HN Who's Hiring: Latest monthly thread

This gives ~500-600 total jobs per ingest run.

Needed

Scale to thousands of relevant opportunities:

New Sources

  • LinkedIn Jobs API — Largest job database
  • Indeed/Glassdoor scraping — Via OpenClaw browser automation
  • AngelList/Wellfound — Startup-focused roles
  • company career pages — Direct scraping via OpenClaw
  • Y Combinator Work at a Startup — Batch companies

Improvements to Existing

  • Dynamic board discovery — Auto-discover Greenhouse/Lever board tokens instead of hardcoded lists
  • Configurable company lists — Let users add/remove companies from the dashboard
  • Deduplication across sources — Same job posted on multiple platforms
  • Freshness tracking — Mark stale jobs, re-check if roles are still open

Labels

feature, ingest, sources

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions