axe-core and devtools results are different

[kriskeiko]

Product

axe-core

Question

I am using the axe-core library with playwright, and when I run it on a page, I get a total of 4 violations, all of them serious. When I use the devtools to do a scan, I get the same 4 serious errors, plus 5 extra errors:

• Images must have alt text (x2)
• Elements must meet minimum color contrast ratio thresholds
• Frames must have an accessible name
• Links must be distinguishable without relaying on color.

Why am I getting different results with the devtools version? Shouldn't they be the same?

[straker]

Thanks for the issue. Just so we're on the same page, which packages are you using exactly? When you say "axe-core library with playwright" do you mean https://www.npmjs.com/package/@axe-core/playwright? And when you say "the devtools" what do you mean?