The Gymnasium library is supported on Linux and Mac OS. If you have trouble installing on Windows, check out my guide Install Gymnasium on Windows
frozen_lake_q.py Solves the FrozenLake-v1 8x8 map with Q-Learning. Companion Youtube video: Solve FrozenLake-v1 8x8 Tutorial
mountain_car_q.py Solves the MountainCar-v0 environment with Q-Learning. Companion Youtube video: Solve MountainCar-v0 Tutorial
cartpole_q.py Solves the CartPole-v1 environment with Q-Learning. Companion Youtube video: Solve CartPole-v1 Tutorial
sb3.py Solves the Humanoid-v4 environment with Stable Baselines3 Soft Actor-Critic. Companion Youtube video: Solve Humanoid-v4 Tutorial