to infinitive or ing form

some verbs can take an object + to -infinitive and

some take an object + an ing form

for example : 1- i ask the teacher to let me go 

2- i can imagine him having good time 

 

the question is :

is any rule tell us about the verbs whom come with to infinitive or whom take ing form?