A "public vehicle" specifically means a vehicle that people ride in to travel, with someone else driving - usually this means something like a taxi car or a bus. Unless it's pluralized, it needs an article like "a" or "the" in front of it to be grammatically correct ("The public vehicle was too small to be comfortable"). "Public transport" means any service people use to travel (except for airplanes, usually, which are considered their own category) where they pay to have someone else take them - this could mean a taxi, a bus, a train, a tram, or various other services. "Public transport" is what we would call a "blanket term," which is a term that is true of many things at the same time, while a "public vehicle" is a specific term that refers to the actual vehicle being driven. A taxi car is a public vehicle that is used for public transport - a car used for a public service.