Skip to content

Conversation

@karashiiro
Copy link
Collaborator

@karashiiro karashiiro commented Nov 10, 2025

Adds experimental (largely untested) support for generating the xp-forwarded-for and x-client-transaction-id headers.

Enable this with the new experimental options on the Scraper instance:

const scraper = new Scraper({
  experimental: {
    xClientTransactionId: true,
    xpff: true,
  },
});

This PR also logs a debug event and simply continues if guest token activation fails. On the website, I'm currently seeing that /activate.json hits 429s on almost every single request, and there are no guest token headers or cookies, yet it's still possible to access the TweetResultByRestId endpoint. I'm taking this to mean that it may not be required anymore, or at least not in all circumstances.

@karashiiro
Copy link
Collaborator Author

#165

@karashiiro karashiiro merged commit c5d95d6 into the-convocation:main Nov 10, 2025
2 of 4 checks passed
@karashiiro karashiiro deleted the feat/xpff branch November 10, 2025 01:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant