The "brethren" are people who share a desire for good from the Lord; the implication is that even the one who is in the smallest degree of that desire is still one of the brethren. In other words, someone who is the least of a group is still in the group.

(References: Matthew 25, Matthew 25:40)