Drag Link

While l rebuilding my steering box I remove and completely cleaned my drag link. Once cleaned I noticed groves and wear inside (while looking into from where the pitman arm ball & bell crank ball would sit). My question is how much wear is allowable on the insides, or is the concern more over the condition of the ball seats and ball seat springs. My guess is that dirt/mud got in there and as a result the grooving.