Release Stitch code and PosEval dataset on Hugging Face

[NielsRogge]

Hi @jabader97 🤗

Niels here from the open-source team at Hugging Face. I discovered your work on Arxiv and was wondering whether you would like to submit it to hf.co/papers to improve its discoverability.If you are one of the authors, you can submit it at https://huggingface.co/papers/submit.

The paper page lets people discuss about your paper and lets them find artifacts about it (your models, datasets or demo for instance), you can also claim
the paper as yours which will show up on your public profile at HF, add Github and project page URLs.

I saw in your GitHub repository (https://github.com/ExplainableML/Stitch) that the "Code for Stitch will be available shortly" and that "The prompts for PosEval can be found in the PosEval/ folder". That's fantastic news!

It'd be great to make the Stitch implementation and the PosEval benchmark dataset available on the 🤗 hub once they are fully released. This would greatly improve their discoverability and visibility within the AI community. We can add tags so that people find them when filtering https://huggingface.co/models and https://huggingface.co/datasets.

Uploading models (Stitch framework)

See here for a guide: https://huggingface.co/docs/hub/models-uploading.

In this case, we could leverage the PyTorchModelHubMixin class which adds from_pretrained and push_to_hub to any custom nn.Module. Alternatively, one can leverages the hf_hub_download one-liner to download a checkpoint from the hub.

We encourage researchers to push each model checkpoint (if Stitch involves specific checkpoints for its application or analysis) to a separate model repository, so that things like download stats also work. We can then also link the checkpoints to the paper page.

Uploading dataset (PosEval)

Would be awesome to make the dataset available on 🤗 , so that people can do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org-or-username/your-dataset")

See here for a guide: https://huggingface.co/docs/datasets/loading.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

Let me know if you're interested/need any help regarding this!

Cheers,

Niels
ML Engineer @ HF 🤗