Usually not, since PE isn't considered as an overall subject. You might say, "He's good in PE." but more common would be something like, "He's a good athlete."

I wouldn't say it that way. 'He's good at PE' sounds more like he is good at 'educating'.