The question was not "is this hard" but instead "is this annoying" the answer is obviously yes no matter your skill level. They aren't challenging in any way, just a pain to deal with when their aggro range is so far and so easily triggered while doing other tasks.
