Goats, as in Leviticus 16:21, 22, signify faith. Because man is regenerated by the Lord by the truth of faith, and consequently, his sins are removed and cast into hell, therefore it is said that "Aaron made the goat bear upon him all the iniquities of the children of Israel unto the land of separation, or into the wilderness." From correspondences, a goat signifies the natural man. The goat which was sacrificed, as in Leviticus 16:5-10, signifies the natural man regarding a part purified, and the goat which was sent into the wilderness regarding the natural man not purified.

(Odkazy: Apocalypse Explained 730)

362. This verse describes the doctrine of faith which is called Cain, and how because it separated faith from love, it also separated it from charity, the offspring of love. Wherever a Church exists, heresies arise in it as a consequence of people basing their thinking on one particular article of faith to which they attach supreme importance. For man's thought process is such that when he focuses his whole attention on any one matter he makes that more important than any other, especially so when delusion claims it as a discovery of his own, and when self-love and love of the world inflate his ego. In that case everything seemingly agrees with it and supports it, even to the extent of his being ready to swear to it when in fact it is false. In the same way people called Cain made faith more essential than love; and because in so doing they were leading lives devoid of love, both self-love and delusion resulting from it banded together in them.