Public Administration is a common university degree.

Yes, that's correct. Though, "I study government" is usually phrased as "I'm studying government" or "I'm doing government studies". Some universities rather than calling it 'government' may call it 'political science'.

I think you would probably study "Political science" or "Politics".