How do I seal the air barrier at the top of the exterior wall?
...air barrier, and in your case it sounds like that wasn’t done. Acoustic seal is horribly messy to work with as it sticks to everything under the sun and is almost impossible to remove, but the bright side is that it works really well for sealing cracks against air leakage.
Always opt for a paintable caulk for baseboa...