Honestly, you’re focusing on the right thing by caring more about keeping the rhythm steady than the odd wrong note. Most listeners won’t even notice a slip if the pulse stays strong, but they will if the beat wobbles. That’s exactly what makes a tune feel danceable.
One thing that helps is slowing right down with a metronome or tapping your foot hard so the beat is locked in your body. Then gradually build speed back up. Another trick is to practice just the left hand or just the right hand against the beat so you’re not juggling everything at once.
Don’t be discouraged, the mistakes are part of the process. The fact you’re aware of where the beat drops means you’re already improving. Keep at it and that steadiness will come.