Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Question] MultiInputPolicy not supported (DroQ) #32

Open
jbirnick opened this issue Mar 6, 2024 · 1 comment
Open

[Question] MultiInputPolicy not supported (DroQ) #32

jbirnick opened this issue Mar 6, 2024 · 1 comment
Labels
question Further information is requested

Comments

@jbirnick
Copy link

jbirnick commented Mar 6, 2024

Hey, I'm trying to use SBX, specifically DroQ, with MultiInputPolicy. I get the error:

ValueError: Policy MultiInputPolicy unknown

Why is that? I thought SBX is compatible with SB3.

@jbirnick jbirnick added the question Further information is requested label Mar 6, 2024
@araffin
Copy link
Owner

araffin commented Mar 6, 2024

Why is that? I thought SBX is compatible with SB3.

"Stable Baselines Jax (SBX) is a proof of concept version of Stable-Baselines3 in Jax.
It provides a minimal number of features compared to SB3 but can be much faster"
from https://stable-baselines3.readthedocs.io/en/master/guide/sbx.html

Not all SB3 features are supported by SBX, CNN and full dict support is missing.
Only basic dict support is there (I would welcome a PR that add this line for Droq, that was an oversight):

sbx/sbx/sac/sac.py

Lines 45 to 46 in db6120b

# Minimal dict support using flatten()
"MultiInputPolicy": SACPolicy,

EDIT: as mentioned in the readme, DroQ can be seen as a special config of SAC, https://github.com/araffin/sbx?tab=readme-ov-file#note-about-droq, which in that case would have the MultiInputPolicy for simple dict spaces

@araffin araffin changed the title [Question] question title [Question] MultiInputPolicy not supported (DroQ) Mar 6, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants