Why is CLIP model created during loading od DINO Encoder? #24

Open

opened

on Aug 27, 2024

MMVP/LLaVA/llava/model/multimodal_encoder/dino_encoder.py

Line 28 in 7635005

    
           self.clip_vision_tower = CLIPVisionModel.from_pretrained(self.vision_tower_name)

Metadata

Assignees

No one assigned

Labels

No labels

No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests