OpenAI Gym render in Jupyter

jupyter_gym_render.py

import gym
from IPython import display
import matplotlib
import matplotlib.pyplot as plt
%matplotlib inline

env = gym.make('Breakout-v0')
env.reset()
img = plt.imshow(env.render(mode='rgb_array')) # only call this once
for _ in range(100):
    img.set_data(env.render(mode='rgb_array')) # just update the data
    display.display(plt.gcf())
    display.clear_output(wait=True)
    action = env.action_space.sample()
    env.step(action)

This is really slow in comparison with the default rendering technique. Also in my case (Windows 10 anaconda) it also opens an ipykernel_launcher

This code gives me 'int' object is not subscriptable