A megger differes from a regular ohmmeter in that it puts several hunderd to several thousand volts across the load. If you have a situation where the insulation breaks down with an arc, you might find it this way but not with a regular meter which puts only a few volts on the load. The higher voltage also allows for resistance measurements several orderd higher than a standard meter.
A standard meter would spot a dead short a mile away though.
Can't inspect all but 8 feet in the wall huh. As Murphy would have it, it must be in there. Any chance a rogue nail to hang a picture punctured the jacket? When they rewired the house, did they remove the wallboard at this section or just shove it through, could have nicked it at that time.
Try swapping this circuit for another (swap the hot wires where they screw in) the tripping should move to the other breaker if it is really line related. This is diagnostically almost identical to changing the bad breaker which you already tried but will douuble your confidence that it is not the breaker or something about the load center.
Try tightening all the screws, even the ones that appear tight, might be another loose one, though open circuits shouldn't trip breakers.
If you had an incandescent lamp plugged in. does it flicker, surge or sag before the breaker trips or just winks out like a normal switch.