Arcana Coelestia # 3169
3169. 'He and the men who were with him' means the things which were in the natural man. This is clear from the representation of 'the servant', to whom 'he' refers here, as the natural man, dealt with in 3019, 3020, and from the meaning of 'the men who were with him' as all things that existed in the natural man, dealt with in 3148.
House
A "house" is essentially a container -- for a person, a family, several families or even a large group with shared interests (think of the term "houses of worship.") In the Bible, a "house" is also a container, but for spiritual things rather than natural things. In various uses a "house" can represent part of the mind, the whole mind, a whole person or even a church. The other nuance to the word "house" is that it is generally used in regards to our affections and desires rather than our thoughts and principles. This makes sense; we tend to engage our thoughts and rationality when we are out in the world doing our work, but when we are inside our houses we are driven most by love for our families and the desire to be good to those we love. So "house" tends to represent the things we want and care about -- which are ultimately the things that define us.