I don't want to go too far afield from the original topic. However, there are plenty of musical systems that are not Western sheet music that do just fine. A notable comparison to reading ABC directly is the Chinese jian pu system. Instead of reading letters, you read numbers, with each number representing the degree of the scale. The musicians read just fine on the fly. It is all a matter of what you are used to.
Note: jian pu uses Western number symbols, which adds a bilingual complexity that ABC doesn't have for us.