| Name | State | Action |
|---|---|---|
| Acrobot-v1 | Box(6) | Discrete(3) |
| CartPole-v1 | Box(4) | Discrete(2) |
| MountainCar-v0 | Box(2) | Discrete(3) |
| MountainCarContinuous-v0 | Box(2) | Box(1) |
| Pendulum-v0 | Box(1) | Box(3) |
| Name | State | Action |
|---|---|---|
| BipedalWalker-v2 | Box(24) | Box(4) |
| BipedalWalkerHardcore-v2 | Box(24) | Box(4) |
| CarRacing-v0 | Box(96, 96, 3) | Box(3) |
| LunarLander-v2 | Box(8) | Discrete(4) |
| LunarLanderContinuous-v2 | Box(8) | Box(2) |