You did nothing wrong, and he did nothing wrong either. Relationships are a process, they take time to develop. Many young people want another person to ‘belong’ to them from the first meeting. I would say that you still don’t have a relationship with him. It is, probably, developing or not. Keep be friend with him, wait and see how it is go. This is just my opinion.