The Machine Learning Toybox for testing of Atari Reinforcement Learning Agents.

View My GitHub Profile

Welcome to!

What is Toybox?

A set of games designed for testing deep RL agents.

If you use this code, or otherwise are inspired by our white-box testing approach, please cite our NeurIPS workshop paper:

  title={Toybox: Better Atari Environments for Testing Reinforcement Learning Agents},
  author={Foley, John and Tosch, Emma and Clary, Kaleigh and Jensen, David},
  booktitle={NeurIPS 2018 Workshop on Systems for ML},

How do I try it? PyPI version

pip install ctoybox
pip install pygame # optional dependency for human_play
python -m ctoybox.human_play amidar

Website still under construction: contact the authors with questions, or post an issue on this repo.