The tools have now been provided to solve motion planning problems using value iteration. The configuration space is a continuous state space; let . The action space is also continuous, . For motion planning problems, is only obtained only when is applied. Therefore, it does not need to be represented separately. To compute optimal cost-to-go functions for motion planning, the main concerns are as follows: