Policy iteration in the checkerboard environment