VoiceOver bot providing incorrect output when testing Action Menu Button Example Using element.focus(), Test 1, V24.10.31)

[jha11y]

Description of Behavior

The VoiceOver bot output was incorrect. Two tests claimed no output but there was output.

Test Setup

• Test File: test-05-navForwardsToMenuButton-voiceover_macos.collected.html
• AT: VoiceOver for macOS (Version 13.7)
• Browser: Safari (Version 18)

[css-meeting-bot]

The ARIA-AT Community Group just discussed VoiceOver bot providing incorrect output when testing Action Menu Button Example Using element.focus(), Test 1, V24.10.31).

The full IRC log of that discussion

<jugglinmike> subtopic: VoiceOver bot providing incorrect output when testing Action Menu Button Example Using element.focus(), Test 1, V24.10.31)
<jugglinmike> github: https://github.com//issues/1160
<jugglinmike> Matt_King_: This is the issue Joe_Humbert was referencing just now. I've renamed it to be focused on the bot
<jugglinmike> Joe_Humbert: I have updated the AT response reported by the bot, is that a problem?
<jugglinmike> howard-e: That's fine. Whatever we need, we can find in the logs
<jugglinmike> IsaDC: I have NOT updated the output reported by the bot for the test plan run assigned to me
<jugglinmike> Joe_Humbert: This is limited to the VoiceOver Bot. The AT responses reported by the NVDA Bot have been accurate
<Joe_Humbert> https://github.com//issues/1163 for can't change AT or browser version
<jugglinmike> Matt_King_: We use different OS APIs for different screen readers. I'm wondering at which layer these problems exist, and if it's the screen reader, if that could make it hard to solve the problem this way

[IsaDC]

The correct test output has been provided by human testers.