Skip to content

Reproducing Table3.  #57

@mjyun01

Description

@mjyun01

CUDA_VISIBLE_DEVICES=0 python opt.py facebook/opt-350m wikitext2 --wbits 3 --new-eval

Table 3 in GPTQ paper reporting wikitext PPL 33.79, but I got 31.90.
How can I get exactly same result with paper?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions