Policy iteration

The policy iteration method of Section 10.2.2 can be applied in principle, but it is unlikely to solve challenging problems. For example, if $\vert X\vert = 10$, then each iteration will require solving matrices that have $1$ million entries! At least they are likely to be sparse in many applications.