The phrase "just for kicks" means "just for the fun of it." So being a rebel just for kicks means that he is enjoying being a rebel against the system for no other reason than he wants to. He doesn't have some cause he is serving or something he is fighting for, but rather just wants to rebel.