Its all about pressure. At sea level there are lots of particles being pulled down to earth by gravity, at higher altitude there is still the same mixture of gases there is just less above it pushing down on that air. Therefore there is less pressure on the gases we breath at higher altitudes.
Comments