Yes it means to pray for someone. When someone says that their friend is in the hospital someone else will say, "We will offer a little prayer for your friend." or interpreted, "We will pray for your friend." I do not like the phrase "a little prayer" because no prayer is too small.

"To say a little prayer" or" to offer a little prayer" are terms used with small children.