Speed generally cannot be "fast" because speed is not something that moves. In this case, it would be "high" speed or "low" speed, or any other descriptor. So if fast or slow, you'd just say, "To speak fast or slow," or "To speak quickly or slowly."