The celluloid is only a thin veneer over the wood case of the instrument. I would echo Lester's comment about making some sort of pilot hole first. If the screws are only small, your pilot hole only needs to be small too, but it ensures a neat and accurate job.
Ideally your pilot hole should be the diameter of the inner shank of the threaded portion of the screw and no deeper than about half the length of the screw. If you don't have a narrow diameter drill, you can probably get away with making a shallow hole with a thin spike, or even tapping in a small nail/panel pin first, but be careful not to overdo it - it is all too easy to make a pilot hole which is too large, and then the screw won't hold properly.