Package organization

[rom1504]

Subsampler packages eg

• ffmpeg
• clip
• image-resize
• whisper

To be used in img2dataset, video2dataset, clip vidéo encode any2dataset etc

Would allow

• easier maintenance by better scoping
• experimental subsampler
• independent optimization
• more contribution by not having to understand the whole code of eg video2dataset

[rom1504]

To make that happen first create a template repo defining the interface of a subsampler and providing the minimum boilerplate

[rom1504]

Then create a simple one as example, eg image resize and try to use it in relevant places

[rom1504]

If that idea work I think it would be cool to apply the same for readers and writers and maybe distributors. That might be less obvious as they're less reusable than the subsamplers