Agreed that it is best to take it all off. But... with the Hohner thick black tape with the water resistant skin I have tried it the easier way and it does work. They seem to have a good bond, but of course they can wear through eventually. I removed all the shiny surface with blunt blades, then lightly sanded the fluff that remained. Any loose bits were removed. This provided a sound base to glue the new strip on.
I replaced the most worn tapes on my old Pokerwork and it feels and looks just fine. I can't see which are the replacements and which are original.
I don't think it would work well on the papery gold tapes, as they always seem to partially unglue themselves, leaving an unreliable surface.