Assuming you are speaking of a roadbike, I would be inclined to leave the pump on. I have never seen an autolube pump fail. Also, the convenience of not pre-mixing oil and gas is worth any perceived risk of failure.
I agree with Jeremy completely. Why do you think Yamaha (and Suzuki, Kawasaki and subsequently all two-stroke manufacturers used an oilpump? Emission and efficiency were the words. Only in roadracing the oilpump was discarded but then also other 2-stroke oil was used. Properly adjusted I have also never seen an oilpump fail. And, it belongs on the old Yamaha's! Ludy Beumer