머물다 or 머무르다 means to stay (for example at a hotel.) -면서 means while. Together, "내 곁에 머물면서" means "While staying by my side, ...."