I'd say "parlavano", as it is a repeated action in the past. By saying "parlarono", I understand that they spoke latin only once, and then something else happened.

' I romani parlavano latino' :)