When I played for morris, we had a system where the dancer in no 1 position would make eye contact with the lead musician and agree on the speed during the once (or more)-to-yourself. It didn't always work, and it was up to the musicians to remind the dancers that this was necessary. Dancers tend to assume that the music will just happen.
This promising start did not, alas, prevent certain players from speeding up the music as the dance proceeded.
To get back to the original query - yes, the breathing thing gets better with practice, at least to the extent that it becomse less obvious to observers. Singing along with the box may help as an exercise.