[BUG]: Dataset inconsistent, some EnvironmentProfile does not exist, like the EnvironmentProfile(01H7VFHP8AN5643B0NR0NP00VE)

[x-awaken]

Description of the bug

I download the redis db from this url : https://cmu.box.com/shared/static/xiivc5z8rnmi1zr6vmk1ohxslylvynur. which is copy from the install console.

Then I get the hard task list through EnvironmentList.get("01HAK34YPB1H1RWXQDASDKHSNS").environments ，the result contains:

        "01H7VFHNV13MHN97GAH73E3KM8",
        "01H7VFHN5WVC5HKKVBHZBA553R",
        "01H7VFHN9W0WAFZCBT09PKJJNK",
        "01H7VFHPDZVVCDZR3AARA547CY",
        "01H7VFHPQQQY6H4DNC6NBQ8XTG",
        "01H7VFHN7WJK7VWVRZZTQ6DX9T",
        "01H7VFHPS5WJW2694R1MNC8JFY",
        "01H7VFHNN7XTR99319DS8KZCQM",
        "01H7VFHQ11NAMZS4A2RDGDB01V",
        "01H7VFHPSWGDGEYRP63H2DJKV0",
        "01H7VFHNF4G18PC9JHGRC8A1R6",
        "01H7VFHNNYH3W0VRWVY178K2TK",
        "01H7VFHP8AN5643B0NR0NP00VE",
        "01H7VFHN7A1ZX5KSMT2YN9RXC4"

The question is that a lot of environment id does not exist in the redis db,like 01H7VFHP8AN5643B0NR0NP00VE

Steps To Reproduce

run the code

from sotopia.database import (

   EnvironmentProfile,
)
EnvironmentProfile.get("01H7VFHP8AN5643B0NR0NP00VE")

Additional Information

No response

[XuhuiZhou]

Hi @x-awaken , sorry for the late response. We are going through some data transition these days so some data might get lost. Can you try this? https://huggingface.co/datasets/cmu-lti/agents_vs_script/resolve/main/dump.rdb?download=true
And see if that solves the issue?