Skip to content

Community Adaptation: Comprehensive support for Chinese Job Boards (BOSS Zhipin, Liepin) #179

@neveevol7

Description

@neveevol7

Code of Conduct

Existing issues

  • I searched existing issues and this hasn't been requested yet

Problem

Hi @santifer,

I have extensively adapted the system for the Chinese job market, which has very strict anti-bot measures.

Key Enhancements:

  1. Stealth Fetching : Developed fetch-jd-stealth.mjs to bypass BOSS Zhipin's protection using human behavior simulation and cookie injection.
  2. Cookie Management : Added save-cookies.mjs for easy session capture.
  3. Localization : Fully translated the README and added Chinese comments to core config files.
    I've also launched a dedicated localized version here: https://github.com/neveevol7/career-ops-cn

I'd love to contribute these improvements back to the community!

Proposed solution

I propose integrating a localized suite for the Chinese market, consisting of:

  1. Session Persistence: A save-cookies.mjs script that allows users to manually log in and capture session cookies via Playwright, enabling access to login-walled content.
  2. Advanced Stealth Crawler: A new fetch-jd-stealth.mjs script that implements anti-detection techniques (removing webdriver flags, human-like scrolling, and random delays) to bypass strict anti-bot systems like BOSS Zhipin.
  3. Platform-Specific Selectors: Optimized DOM selectors for major Chinese portals (BOSS Zhipin, Liepin, 51job) to ensure accurate JD extraction.
  4. Bilingual Configuration: Chinese translations and annotations for core configuration files (profile.yml, portals.yml) to lower the entry barrier for Chinese users.

Area

Language / i18n

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions