I am not a native speaker but, as I understand these words it's:
Clever can also mean something like a clever trick, so an evil plan.
Smart can also, more or less, mean pretty, witty, inventive. So more than just high grades. If a girl says you are 'a smart boy', it could mean more than just sheer 'intelligence' she is referring to.
If a native speaker disagrees please correct me.