Going up refers to going towards spiritual and celestial things, for these are inward things, and are also believed to be higher. Going down refers to going towards natural and earthly things, for these are outward things, and also appear lower.

(References: Arcana Coelestia 5406)