The phrase you are looking for is 'I have a conscience'. 'Conscience' tends to be used in quite a general way, so if you want to refer to a specific situation, you could say 'I have a guilty conscience about ...'.