Fifth probably refers to street name. Many U.S. cities have numbered streets. You didn't provide context, but It sounds as if the character is looking at a map and describing the route to take.

It means you're going to turn right on fifth street. By the context of your sentence, it seems you're approaching that street and have to make a right there.