Perhaps:
We are allowed to move one step vertically or horizontally, but not diagonally. We can move from any given node to the node above it, below it, to its right, or to its left.
Are you describing a king in chess? If so, use "square" instead of "node".