Skip to content

Request: Test Split Expressions and Annotations #27

@akramsalim

Description

@akramsalim

Summary:
I am using the Refer-KITTI-V2 dataset for my master's thesis research on Vision-Language Models for referring multi-object
tracking in autonomous driving. I would like to request access to the test split expressions and annotations to properly
evaluate my model according to the dataset's intended evaluation protocol.

Background:

  • The Refer-KITTI-V2 paper mentions a train/val/test split
  • Currently, the repository provides:
    • Training split: expressions and annotations available (i used part of it as a validation split)
    • Test split: only images available (no expressions/annotations)

Request:
Could you please provide or make available:

  1. Test split referring expressions (JSON files in expressions/ directory)
  2. Test split annotations/labels (TXT files in labels/ directory)

Use Case:

  • Research Purpose: Master's thesis on fine-tuning Qwen2.5-VL for RMOT
  • Evaluation Need: Following the paper's evaluation protocol requires test split metrics
  • Academic Use Only: Results will be used in thesis and potential publication with proper citation

Alternative:
If the test split annotations are intentionally held out for leaderboard/benchmark purposes, please let me know:

  • Is there an evaluation server where I can submit predictions?

Thank you for creating and maintaining this valuable dataset! Any guidance on the proper evaluation protocol would be greatly
appreciated.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions