Value Iteration Demo

Instructions

Start: Initiates the simulation with the chosen settings. The default speed is 1x.
Speed Control: Adjust the simulation speed using the slider provided.
Reset: Resets the simulation to its initial state.
Grid Size: Modify the grid size using the dropdown menu.
Creating Obstacles: Click once on any cell in the left grid to make it an obstacle (blocked state).
Setting Rewards: Double-click a cell to cycle its state through green (reward: 1), red (penalty: -1), and back to normal.
Animation: The left grid animates the current cell being calculated, while the right grid highlights the corresponding state value.

Calculation of value function of a state appears here

Present Iteration

Iterations :

Discount Factor :

0.9

Reward :

0.0

Grid Size :

Min.Speed

Max.Speed