"For a momentary thrill sounds more natural to me."

I can't imagine a native speaker saying "for a moment of thrill." More likely " for a momentary thrill" or perhaps "for a thrilling moment."

For a momentary thrill sounds better. You could also say "for a moment of excitement."

Yes, you can! :)