There're a couple of ways to say that in English.
For example, "午後(に)はいつも", "いつも午後に(は)","午後になるといつも", and such. It's kind of gramatical matter.
I guess you wodered if we have a conventional phrase that corresponds to "every afternoon", but we don't have that one I think.
Unlike "every morning 毎朝(mai-asa)", "every evening 毎晩(mai-ban)", we do NOT say "毎午後". So..I would use "いつも午後に" like..."いつも午後に、散策します。"