Goats, as in Leviticus 16:21, 22, signify faith. Because man is regenerated by the Lord by the truth of faith, and consequently, his sins are removed and cast into hell, therefore it is said that "Aaron made the goat bear upon him all the iniquities of the children of Israel unto the land of separation, or into the wilderness." From correspondences, a goat signifies the natural man. The goat which was sacrificed, as in Leviticus 16:5-10, signifies the natural man regarding a part purified, and the goat which was sent into the wilderness regarding the natural man not purified.

(Odkazy: Apocalypse Explained 730)

3218. When angels are stirred by affections and at the same time are discussing these, such things manifest themselves among spirits in the lower sphere as representative types of animals. When the discussion concerns good affections, beautiful, gentle, and useful animals emerge such as those used in sacrifices in the Divine representative worship within the Jewish Church - such as lambs, sheep, kids, she-goats, rams, he-goats, calves, young bulls, and oxen. And whatever is seen at any time on the animal represents some mental image in the angels' thought, which upright spirits are also allowed to perceive. From this one may see what was meant by the animals in the religious observances of the Jewish Church, and what by the same animals when mentioned in the Word, namely affections, 1823, 2179, 2180. But when angels' discussion is about evil affections it is represented by offensive, vicious creatures serving no use, such as tigers, bears, wolves, scorpions, serpents, rats, and so on, even as such affections are also meant by these in the Word.