There's no simple little trick. You just need to remember which verbs take the infinitive, which ones take the gerund, which take both with no difference in meaning, and which take both with a clear difference in meaning.

Look up "verbs followed by gerund/infinitive".