Minari Integration with CORL

[Howuhh]

There we will track out progress for Minari integration with CORL. Minari is a standard format for offline RL datasets, with popular reference datasets and related utilities, which we believe will replace D4RL in the future by combining most of the existing benchmarks under unified interface and storage. And we want to be prepared! Eventually this will become a CORLv2.

The plan is to add an experimental separate directory with algorithms using Minari and to retraing all algorithms on the D4RL datasets currently (and in the future) re-created in the Minari.

Adapted algorithms:

• BC
• TD3 + BC
• AWAC
• CQL
• IQL
• SAC-N
• EDAC
• DT

Retrained algorithms (only Adroit for now):

• BC
• TD3 + BC
• AWAC
• CQL
• IQL
• SAC-N
• EDAC
• DT

[masonhargrave]

This is a really good idea! Would love to see this happen.

[Howuhh]

@masonhargrave It's certainly going to happen! However, you need to be patient as we are waiting for a stable release of Minari to continue working on it. Right now it's missing most of the datasets from D4RL, without which it's hard to benchmark.

[jamartinh]

@masonhargrave @Howuhh

In the meantime, to avoid problems with the large dependencies and unnecessary things of D4RL to just use the datasets I have made an almost single file version of d4lr datasets downloader.

d4rllite

It seems, as well, that Minari versions are very close to be ready soon.