If you 'wonder' about something you want to know about it and you ask for information. The other person called many times to find out where the writer had been.
By the way, I hope you realise that this is colloquial, non-standard English. More correctly, it should be 'But you called about a thousand times wondering where I had been/where I was'.