Hi Avijit,
I think you shouldn´t stop speaking at all, that shows your insecurity, which is negative.
As Lin said, you can do a pause and politely give an excuse saying that you want start again.
Other tips
-If you get stuck in a word or phrase you don´t know or remember, paraphrase, use different words to say what you want to say. For example: "banana" - a curved, yellow fruit similar to the moon.
-Use "fillers", words or frases like, ummm, like, I mean, you know, basically, actually, so, okay, right, well, etc. Thety will give you additional time to think what you want to say.
-Be patient, a language can´t be lernt in short time. You need practice, practice and more practice.
IHIH
Leo