Skip to content

Cannot use with files-to-prompt #17

@hyperknot

Description

@hyperknot
files-to-prompt . -e ts | ttok
Error: Encountered text corresponding to disallowed special token '<|endoftext|>'.
Use --allow-special to allow special tokens

then

files-to-prompt . -e ts | ttok --allow-special
Error: Cannot use --allow-special without --encode or --tokens

Then with --encode or --tokens I cannot count it. I just want to see how many tokens would it use to query the current directory.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions