As designed, labels for cursors and annotations are not hit test targets, but this seems like a reasonable expectation in your scenario. I have updated the hit testing issue with a request to include labels.
I could not reproduce your issue with the annotation arrow. Clicking on the arrow head and the arrow line both worked, though you do have to click exactly on the object. Since you are using touch interaction, you may want to test additional pixel coordinates around the event, rather than just the exact pixel location reported.
~ Paul H
