Actually, the pronouns "me" and "te" can be either object direct pronouns or indirect object pronouns. So the confusion lies entirely in this : for the first and the second person, they are the same!
Just as a reminder, the direct object pronouns are: me, te, le/la (+se), nous, vous, les (and en),
whereas the indirect object pronouns are : me, te, lui ( +se), nous, vous, leur (and y).
Hope that helps...