-
Notifications
You must be signed in to change notification settings - Fork 9
Open
Description
Summary:
I am using the Refer-KITTI-V2 dataset for my master's thesis research on Vision-Language Models for referring multi-object
tracking in autonomous driving. I would like to request access to the test split expressions and annotations to properly
evaluate my model according to the dataset's intended evaluation protocol.
Background:
- The Refer-KITTI-V2 paper mentions a train/val/test split
- Currently, the repository provides:
- Training split: expressions and annotations available (i used part of it as a validation split)
- Test split: only images available (no expressions/annotations)
Request:
Could you please provide or make available:
- Test split referring expressions (JSON files in
expressions/directory) - Test split annotations/labels (TXT files in
labels/directory)
Use Case:
- Research Purpose: Master's thesis on fine-tuning Qwen2.5-VL for RMOT
- Evaluation Need: Following the paper's evaluation protocol requires test split metrics
- Academic Use Only: Results will be used in thesis and potential publication with proper citation
Alternative:
If the test split annotations are intentionally held out for leaderboard/benchmark purposes, please let me know:
- Is there an evaluation server where I can submit predictions?
Thank you for creating and maintaining this valuable dataset! Any guidance on the proper evaluation protocol would be greatly
appreciated.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels