They mean two different things.
"Join in" means to "start participating" so you "join in" a conversation.
"Join up" means to enroll or meet, so when you go into the army, you "join up". You also use it in sentences like, "I'll join up with you when I am finished."
In your phrase as written, you need simply "join". "A course I'd like to join."