How to use the module

Prerequisites

This module assumes that you’ve properly configured and started all the modules
If not please refer to how to setup the framework tutorial

Framework usage

If you have configured everything correctly you’ll need to:

  1. Open the browser

  2. Type localhost:3000

You should see the following screen

../_images/main_screen.png

If you see any errors restart all the modules and try again.

Main page

../_images/main_screen.png

On the main page you can:

  1. Start training/testing the model on the game

  2. Import model from the zip file

  3. Export current model to the zip file

NOTE - training reinforcement learning models is a very time consuming task. We recommend to train models for at least several hours (in case of Freecell/2048 with default model parameters training took around 24 hours). Please be aware that training times may vary a lot. We recommend that you check logs and statistics sporadically to see how the model is performing.

Configuration

../_images/configuration_1.png ../_images/configuration_2.png

On the configuration page you can:

  1. Create new model by choosing algorithm and setting the values of all available parameters

  2. Modify current model by setting the values of all available parameters

The list of available parameters is dependent on the model you’ve chosen
NOTE - some parameters may not be possible to modify after training has started
If you’ve misconfigured the model and did not start training we recommend that you create a new model from scratch

Logs

../_images/logs.png

On the logs page you can:

  1. See all the logs from the current session

  2. Filter logs based on given conditions

Statistics

../_images/statistics_1.png ../_images/statistics_2.png

On the statistics page you can:

  1. See how the reward has changed throughout the training/testing. You can smoothen the results

  2. See the number of won/lost games by the model. You can also see the number of games that did not finish due to the timeout

Visualization (on the example of FreeCell game)

../_images/visualization_1.png ../_images/visualization_2.png

On the visualization page you can:

  1. See how the model performed on each game by seeing the visualization of all the moves made by the model

NOTE - visualization page redirects to visualization module. If visualization module is not running that this page won’t work.