As with many verbs, the meaning of "remove" in the Bible varies a good bit depending on context. It generally involves a separation of spiritual states, and in most cases specifically refers to a kind of sorting-out process to separate true ideas from false ones.

(Референци: Arcana Coelestia 932, 3993, 4544, 6371, 7392, 9258; The Apocalypse Explained 811 [6])

4544. 'Remove the gods of the foreigner which are in the midst of you' means that falsities were to be cast aside. This is clear from the meaning of 'removing' as casting aside, and from the meaning of 'the gods of the foreigner' as falsities; for in the Word 'gods' means truths and in the contrary sense falsities, 4402. Those people were called 'foreigners' who were outside the Church and therefore those who were subject to falsities and evils, 2049, 2115; and this explains why 'the gods of the foreigner' means falsities.