Skip to content

fetch_all_comments stops before all comments are retrieved #1

@pushshift

Description

@pushshift

The current logic used to determine if all comments have been fetched is to use the "hasMore" field value to stop collecting comments for a video id. Apparently this field will return false when there are still additional comments that can be retrieved.

Additional comments can be retrieved by incrementing the cursor value to the appropriate value (the cursor parameter is used as a pagination value).

Additional logic needs to be put in place to ignore the hasMore field to continue collecting comments and terminating when all comments are collected. This may involve keeping a count of the total comments reported by the TikTok API and continuing to fetch additional comments until the total number fetched is near the reported total comment value.

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions