At what point does a wrist lock become grabbing the glove? its an issue ive raised with refs at events and they dont seem to switched on with this???

a fighter attacks a wrist from guard to aid a sweep or turnover, but has to grab the hand/glove!

does a referee

A) wait to see what the fighter is doing with the hand

B) warn the fighter to let go of the glove?