It depends on how your feelings relates to the action
I would say either: "I am too ashamed to speak in public"
or "I am ashamed when speaking in public"
Ashamed might not be the exact word you're looking for, maybe "nervous" or "shy" could fit better
Example: "I get nervous when speaking in public"