Sort of. The following afternoon is the afternoon that follows. But it usually means the afternoon of the following day. We don't usually say "the next afternoon". We have set expressions: next year next month tomorrow afternoon etc...

basically, yes. "the next afternoon" would sound awkward though. you can simply say "tomorrow afternoon." :)