Skip to content

Commit

Permalink
Fix number of states written in getting started notebook
Browse files Browse the repository at this point in the history
  • Loading branch information
cassidylaidlaw committed Apr 19, 2024
1 parent c75aa51 commit 3747b1b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion getting_started.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -207,7 +207,7 @@
"cell_type": "markdown",
"metadata": {},
"source": [
"Both the `transitions` and `rewards` matrices are of size `(num_states, num_actions)`. As we can see, this MDP has 158 states (157 non-terminal states plus the terminal state) and 6 actions. `transitions[0]` gives the states that are reached by taking each action in the initial state, which is always at index 0.\n",
"Both the `transitions` and `rewards` matrices are of size `(num_states, num_actions)`. As we can see, this MDP has 169 states (168 non-terminal states plus the terminal state) and 6 actions. `transitions[0]` gives the states that are reached by taking each action in the initial state, which is always at index 0.\n",
"\n",
"Now, let's use value iteration to determine an optimal policy for this MDP."
]
Expand Down

0 comments on commit 3747b1b

Please sign in to comment.