It can mean that, yes. However, it can be used in other circumstances, as well. It is used to express that there is a limit to how much someone can handle, mind or body--whether it is having patience, lifting weights, being hit in a boxing match, etc. This expression can be used in multiple ways.

Wives and girlfriends are always trying to teach their husbands/boyfriends patience. Unfortunately, guys are slow learners.