Anything's possible. Get a magnetic base and a dial indicator. While you have the rocker shaft off, put it on all the pushrods and see if they all travel the same.
You could also fire it up with the valve cover off and listen. You'll get a few oil spatters but nothing major.
If the noise if from a wiped cam, the lifter and pushrod should be sitting low in the engine. While that one is on the base circle, the rocker should be 'sloppier' than the others.