Unless you have an interference fit the grub screw *will* shift the gear, you need to decide how much you can tolerate. For a close, free fit I'd shoot for .01mm to .03mm clearance between the shaft and bore. Any tighter and you're likely to have to apply some force to get the gear on the shaft unless the finish, roundness, and straightness of the bore is very good. Much looser and you'll have a fair amount of perceptible play before the screw is tightened. I'm assuming the bore is not unusually long, say no more than 4x the diameter.
Keep in mind you need to take into account the tolerance on the shaft in order to maintain the desired fit. In other words, if the shaft is
4.75/4.74 the bore should be 4.77/4.76 if you want to maintain the fit suggested above.Ned Simmons