Voy a mi bicicleta means you're going to your bike.
In Mexico we say "ando en bicicleta". This simply means you usually use your bike as transportation, or that you're going for a ride (Voy a andar en bicicleta). "Paseo en bicicleta" means you're using it to enjoy the view and have fun.