MetaMorph is a UI element detector that detects constituent UI elements of freehand lo-fi sketches using DNN based object detection models.
-
Updated
Feb 25, 2024 - Python
MetaMorph is a UI element detector that detects constituent UI elements of freehand lo-fi sketches using DNN based object detection models.
Set-of-Mark detection pipeline for macOS — Apple Vision, YOLO11, and VLM on MLX. Transforms screenshots into numbered element maps and structured JSON manifests.
Temporal smoothing for UI element detection with OmniParser integration
Generate 800K GUI element question-answer pairs for training small Vision Language Models. Transform 80,000 base GUI elements into comprehensive training dataset using LLM-powered paraphrase generation.
Add a description, image, and links to the ui-detection topic page so that developers can more easily learn about it.
To associate your repository with the ui-detection topic, visit your repo's landing page and select "manage topics."