Yeah. Is it correct? 

A better English translation might be, "Follow your own course (take your own path?), and let others talk.

Just to make sure, the meaning here is to -- do your own thing, and disregard what other people might say or think.  Right?