The Lord created us to be separate from Himself, so that He could love us. He thus allows us to act contrary to His will -- to want what is evil and to believe what is false. When we accept the Lord, though -- by learning what's true and determining to live according to it -- we can let Him place inside us a love for what is good. That is our "inheritance.

4544. 'Remove the gods of the foreigner which are in the midst of you' means that falsities were to be cast aside. This is clear from the meaning of 'removing' as casting aside, and from the meaning of 'the gods of the foreigner' as falsities; for in the Word 'gods' means truths and in the contrary sense falsities, 4402. Those people were called 'foreigners' who were outside the Church and therefore those who were subject to falsities and evils, 2049, 2115; and this explains why 'the gods of the foreigner' means falsities.