I think "baka" can also be translated as "silly". So just like the word "silly", if you say like "baka dane" with a smile (as you say "you silly" with a smile). Of course, you can say this to your close friends/family members only; to others it will most likely be offensive...