A plug is either an object used to fill a hole, or a cord that plugs into a wall for electricity. Both these are nouns, but can be used a verb.
Ex. "Can you please plug the computer in?"
Connect means to join, unite or fasten together. People can connect with another, but you may also connect objects, like phones and internet. It is always a verb :)
Ex. "I can really connect with you. We're very similar."
"My internet is finally connected. I can talk to you on Skype."