Get Open AI (gym) up and running on Windows Subsystem Linux

Quick list of steps to get Open AI running on Windows

1. Activate WSL (Bash on Windows). Refer this for detailed steps.


2. Run the following commands on Bash. These replace the default libzmq3 installation with one having a bug-fix.

pip uninstall pyzmq
sudo add-apt-repository ppa:aseering/wsl
sudo apt-get update
sudo apt-get install libzmq3 libzmq3-dev
export LD_LIBRARY_PATH=/usr/lib/x86_64-linux-gnu
pip install --no-use-wheel -v pyzmq
pip install jupyter

3. Install dependencies for gym:

sudo apt-get install -y build-essential
sudo apt-get install -y zlib1g-dev liblapack-dev libatlas-base-dev libopenblas-dev libhdf5-dev libedit-dev
pip install gym[all]

Get Bash on Windows 10 Build 14316

To get Bash (Ubuntu) as part of Windows 10, you first need to become an 'insider'.

• Go to Settings > Update & Security > Advanced Options and toggle the Get Insider Preview Builds option with the level to Fast.
• From Settings > Update & Security > For Developers enable Developer mode.
• Go to Settings > Update & Security > Advanced Options and in the section Choose how updates are delivered, turn the option for PC's on my local network and the internet on. (This isn't required, but let me download the build immediately after I enabled it).
• After you get the build, go to Programs and Features from the Control Panel and choose option Turn Windows Features on or off. Enable Windows subsystem for Linux (Beta)
• Search for bash in the start menu and you're all set!