Do you have a diagram showing effect of winds on the pressure inside the house?
...wind will create a negative pressure outside of your north wall, so more than just being an issue of increased air pressure inside the house, wind will create a negative pressure on the opposite side of a home and draw air from that wall.
Air pressure in the home will also be affected by any mechanical exhaust you have...