the meaning of this is very clear however that would not be how it is said. what people would more commonly say is 'come over to my house tomorrow'. English is my first language but unfortunatly i can still not explain why we would say it like this, it just sounds better. Additionally, i do not know the context of this but a phrase such as this would normal be put less directly for example: 'would you like to come to my house tomorrow' 'you can come to my house tomorrow (if you want)' 'you can come home with me tomorrow' (this last one is extremely casual and would only be used with friends (of the same gender))