First of all, the phrase 'Stop By' means 'To visit a person or place for a short time, usually, when you're going somewhere else, but passing by that place'.
So, your sentence 'Stop by when you're around' means 'Come my house/room and visit me when you're passing by my house/ room.'