Skip to content

feat: add Chinese Clip#27

Open
ChesonHuang wants to merge 3 commits intodata2ml:mainfrom
ChesonHuang:chinese_clip
Open

feat: add Chinese Clip#27
ChesonHuang wants to merge 3 commits intodata2ml:mainfrom
ChesonHuang:chinese_clip

Conversation

@ChesonHuang
Copy link
Copy Markdown

To support Chinese Clip
Chinese Clip Project: https://github.com/OFA-Sys/Chinese-CLIP
the state_dict of Chinese Clip is different from the exists CLIPs, it will raise errors like:
raise RuntimeError('Error(s) in loading state_dict for {}:\n\t{}'.format( RuntimeError: Error(s) in loading state_dict for CLIP: Missing key(s) in state_dict: "positional_embedding"... Unexpected key(s) in state_dict: "bert.embedding" ...
So i write some code to support Chinese CLIP

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants