Yeah, I totally don't understand that. According to the story, YOU are confused which way to go. You bump into him the in hallway on the way to the restroom.
"For a while you wait, but soon you have to go to the bathroom. It's been a while since you came to Morty's, and you have to remember.
"Down the hall behind the counter, take a left, and the Men's room is on the left...no, right."
A few steps down the hall, right before that crucial left turn,the huge man in front of you stops for a moment.
Since you're too busy thinking,you bump right into him."