Skip to content

Add openCLIP hf and local model types#42

Open
taiqihe wants to merge 2 commits intodata2ml:mainfrom
taiqihe:main
Open

Add openCLIP hf and local model types#42
taiqihe wants to merge 2 commits intodata2ml:mainfrom
taiqihe:main

Conversation

@taiqihe
Copy link
Copy Markdown

@taiqihe taiqihe commented Oct 17, 2025

I updated the openCLIP wrapper so that we can load models from hf hub or locally, using the openCLIP schema.

Models like timm/PE-Core-bigG-14-448 can only be loaded through openCLIP and not hf itself. So now users would be able to specify open_clip_hf:timm/PE-Core-bigG-14-448 which maps to hf-hub:timm/PE-Core-bigG-14-448 for openCLIP and use that for downstream applications.

I think the openCLIP version requirement should be bumped to allow >=3 for loading local directories, unless there's some other incompatibility that I'm not aware of.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant