The phrase means "exactly" or "precisely" and refers to what was just said. It carries the connotation that one believes a request or demand is reasonable.
For instance, a teacher may say to his students, "I don't expect you all to be straight-A students. I don't expect that you will all love math or enjoy it. I expect only that you each try your hardest at all times—nothing more, nothing less."