This contains a dockerfile to build a patched version of the openai's flashgame docker image that fixes the issue: openai/universe#182