Yes absolutely you can. In fact, all native English speakers learned by just speaking while they were still babies, not being able to write until they were older.
But you need a lot more of interaction to be able to do this. If you want to have lessons with just speaking and no reading or writing, message me and we can set up an appointment. In fact, it is my favorite teaching style! 😅