The package was originally designed to work with a handful of POMDPs from the POMDPs.jl ecosystem. Now that it is more general, we should probably change the design so that it assumes a problem conforms to the CommonRLInterface and not an POMDP/MDP interface. We can easily construct a CommonRLInterface from the POMDP or MDP (thats effectively what is happening here:
).