There is no passive voice of "to go". Only transitive verbs can be used in the passive in English. In the passive voice the verb is reinterpreted with the object as the grammatical subject; so if there is no object in the active voice, the passive cannot be formed.