양심상 means 'by following your conscience' so it would be like 'in all good conscience' in English. Hope it helps and please follow me at koreanclass.canada on Instagram ! :)