High air pressure means that the air is descending and that air will become warm. That is why high air pressure is associated with good weather.
Low air pressure means that as the air rises, it will cool, which will then increase the humidity, and this can cause rain, snow, or even ice. That is why low air pressure is associated with bad weather.