The number "two" has two different meanings in the Bible. In most cases "two" indicates a joining together or unification. This is easy to see if we consider the conflicts we tend to have between our "hearts" and our "heads" -- between what we want and what we know. Our "hearts" tell us that we want pie with ice cream for dinner; our "heads" tell us we should have grilled chicken and salad. If we can bring those two together and actually want what's good for us, we'll be pretty happy. We're built that way -- with our emotions balanced against our intellect -- because the Lord is built that way. His essence is love itself, or Divine Love, the source of all caring, emotion and energy. It is expressed as Divine Wisdom, which gives form to that love and puts it to work, and is the source of all knowledge and reasoning. In His case the two aspects are always in conjunction, always in harmony. It's easy also to see how that duality is reflected throughout creation: plants and animals, food and drink, silver and gold. Most importantly, it's reflected in the two genders, with women representing love and men representing wisdom. That's the underlying reason why conjunction in marriage is such a holy thing. So when "two" is used in the Bible to indicate some sort of pairing or unity, it means a joining together. In rare cases, however, "two" is used more purely as a number. In these cases it stands for a profane or unholy state that comes before a holy one. This is because "three" represents a state of holiness and completion (Jesus, for instance, rose from the tomb on the third day), and "two" represents the state just before it.

'The former heavens, which passed away,' as mentioned in Revelation 21:1, signify the societies of people in the spiritual world who were only in external or apparent good. (Apocalypse Explained 675) Heavens are celestial and spiritual things. Consequently, they are inmost things, both of the Lord's kingdom in heaven and in the earth. This also refers to the church, and every individual, who is a kingdom of the Lord, or a 'church.' Consequently, heavens denote all things pertaining to love and charity, and faith grounded in them, as well as all things pertaining to internal worship. In like manner they denote all things pertaining to the internal sense of the Word. All these things are heavens, and are called, 'the throne of the Lord.' (Arcana Coelestia 2162)

(References: Apocalypse Explained 21)