Oh, I forgot to mention, I am not as fortunate as @jaff, my tape library only has one SAS port, and so I cannot use the two cable solution.
And I am seeing the issue on read, not write, but it also only appears for larger data transfer tasks, all the smaller tasks of changing tapes, etc, work...