Value Iteration Practice

Instructions

Reset: Resets the simulation to its initial state.
Next Value: Calculates and updates the value for the next state.
Next Iteration: Performs calculations for all states to complete a full iteration.
Grid Customization: Adjust grid size, rewards, and discount factor using the dropdown menus provided.
Creating Obstacles: Single click on any cell in the left grid to set it as an obstacle (blocked state).
Setting Rewards: Double-click a cell to toggle its state between green (reward: 1), red (penalty: -1), and normal state.
Grid Animation: The left grid shows a visual representation of the cell currently being calculated, with the corresponding state value highlighted on the right grid.

Calculation of value function of a state appears here

Present Iteration

Iterations :

Discount:

Reward :

Grid Size :