Skip to content

[Question]: Are benchmark metadata annotations available for the remaining GRScenes-100 scenes? #95

Description

@xuyicheng-zju

Question

Hi InternUtopia team,

We really appreciate your great work, we found that GRScenes-100 contains
69 home scenes and 30 commercial scenes, but the released
benchmark/meta.zip contains rich benchmark metadata for only 30 home scenes.

For these 30 scenes, the metadata includes files such as:

  • object_dict_with_caption.json
  • object_dict.json
  • model_mapping.json
  • annotation.json
  • occupancy.npy
  • paths.json
  • rgb_init.png

The released mm_episodes.json and sn_episodes.json also appear to reference
exactly this same set of 30 scenes (20 test and 10 validation scenes).

The per-scene metadata.json files inside GRScenes-100 record model and
material references, but they do not appear to provide the same object-level
semantics, room membership, spatial relations, occupancy-coordinate metadata,
and route annotations required for benchmark episode authoring.

Could you please clarify:

  1. Is the 30-scene metadata subset intentional?
  2. Are equivalent benchmark metadata annotations available for the remaining
    39 home scenes and the 30 commercial scenes in another release, branch, or
    download source?
  3. If these annotations have not been released, is there a plan to release them?

Thank you!

Metadata

Metadata

Assignees

No one assigned

    Labels

    triage-neededIndicates an issue or PR lacks a `triage/foo` label and requires onetype/questionQuestion about usage or feature

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions