Mental model

Accessibility Testing Methods

Systematic approaches combining automated tools, manual inspection, assistive technology testing, and user research to ensure digital products work for people with disabilities.

Discover

You've run an automated accessibility scanner on your website and it reports zero issues. But when a screen reader user tries to use your site, they can't complete a purchase. How did the tests miss something so critical?

Choose the step that should come FIRST in an effective accessibility testing process

Understanding each method's strengths reveals why a single approach misses critical issues.

Understand

Understand

Accessibility testing uses multiple methods to check if digital products work for people with disabilities. Automated tools find common issues like missing image descriptions and broken keyboard navigation, but they can't judge whether your content makes sense or flows logically. Manual testing with assistive technologies like screen readers, magnifiers, and voice control catches problems automation misses, while testing with actual disabled users reveals usability gaps no tool can detect. Relying on just one method creates a false sense of security—a clean automated report doesn't mean your site is actually accessible. Check this: Try navigating your website using only your keyboard to immediately uncover issues automated tools miss.

Full explanation

Full explanation

Accessibility testing follows a layered process that combines complementary methods. First, automated scanning tools check code against programmatically testable requirements like missing alt text, insufficient color contrast, and duplicate page headings. These tools cannot determine if alternative text actually describes an image meaningfully or if interactive elements make sense to users. Common automated tools include axe-core, Lighthouse, and WAVE.

Next comes manual inspection and keyboard testing, where evaluators navigate through the site using only a keyboard to verify all interactive elements are reachable and operable. This step identifies issues like keyboard traps where users get stuck in certain components, missing focus indicators that show which element is selected, and illogical tab orders that jump around the page unpredictably. Testers also inspect code for semantic HTML structure, proper ARIA attributes, and heading hierarchy—things that affect how assistive technologies interpret and present content to users.

Assistive technology testing involves using actual tools that disabled people rely on: screen readers like NVDA, JAWS, or VoiceOver for visual impairments; screen magnification software for low vision; and voice control tools like Dragon Naturally Speaking for mobility impairments. Each assistive technology reveals different problems—a screen reader might announce a button as "unlabeled graphic" while a magnifier user might struggle with content that reflows poorly when zoomed. This requires learning how disabled users actually interact with technology, not just simulating the experience.

The most critical method is testing with people who have disabilities, as no automated or manual test can fully capture real user experience. A user might successfully navigate a form technically but still find it cognitively overwhelming, or they might understand your content but experience fatigue from excessive verbosity. Including disabled users throughout design and development helps teams learn directly how their decisions impact real people, builds empathy, and reveals issues that would otherwise surface only after launch when fixing them becomes far more expensive.

Research

Research

Automated accessibility testing provides foundational coverage but cannot capture the full user experience. Manual inspection and assistive technology testing reveal barriers that code-only scanning misses, while testing with disabled people identifies usability gaps that no technical assessment can detect. [1] The W3C's WCAG-EM (Website Accessibility Conformance Evaluation Methodology) provides a structured framework for comprehensive evaluation, emphasizing that no single method is sufficient and that knowledgeable human judgment is required to determine true conformance. [2] Studies also highlight the value of including disabled users throughout development—research shows teams that involve people with disabilities in the design process identify usability barriers that pure technical testing misses, leading to more effective and inclusive solutions. [3]

Recent work examines emerging approaches like AI-assisted testing, which shows promise for catching more complex issues but still cannot replace human judgment for assessing user experience. [4] The W3C's ACT Rules (Accessibility Conformance Testing Rules) community develops standardized test rules that enable more consistent automated testing while acknowledging that approximately half of WCAG success criteria require some manual verification. [5]

Limitations

Limitations

Automated testing cannot assess content quality, logical flow, or whether alternative text actually conveys meaning. Manual testing without disabled users assumes you know how assistive technologies are actually used in practice—experts note that screen reader power users employ techniques novices wouldn't discover. Testing with disabled users has its own constraints: small sample sizes, difficulty recruiting participants representing the full spectrum of disabilities, and the fact that individual expertise with assistive technologies varies widely. Organizations also face resource limitations—comprehensive testing requires specialized tools, training, and time that many projects lack. Finally, passing WCAG criteria doesn't guarantee usability; it's possible to be technically compliant while still providing a poor user experience.

Try it

Synthesize

Choose a pattern from the guide, then pick an action to try with it.

Which pattern stands out?

What will you try?

Choose a pattern above to select an action.

Sources

Sources

Try it

Check your understanding

An e-commerce site passes all automated accessibility tests with zero errors. When a blind user tries to complete a purchase, they abandon because the checkout flow announces confusing information to their screen reader. What testing method would have most likely caught this issue before launch?

Show the guide's explanation

Answer: Test with actual screen reader users during development

Automated tools cannot evaluate whether content makes sense or flows logically to users. Only testing with people who actually use screen readers in their daily lives can reveal confusing navigation, unclear labeling, or cognitive load issues that cause abandonment. The other options focus on technical compliance rather than real user experience.

Which testing method should come FIRST in a comprehensive accessibility testing strategy?

Show the guide's explanation

Answer: Run automated accessibility scanning tools

Starting with automated tools is most efficient because they quickly identify issues that are programmatically detectable (such as missing alt text, broken keyboard access, and low contrast) across entire pages. This creates a baseline that makes subsequent manual testing, assistive technology testing, and user testing more focused and productive—rather than wasting human expertise on problems tools can catch automatically.

A developer claims their site is accessible because an automated tool reported zero errors. Which statement best explains why this conclusion is problematic?

Show the guide's explanation

Answer: Automated testing cannot detect most accessibility issues, especially those requiring human judgment

Automated tools can only detect certain types of technical issues (such as missing alt text attributes) but cannot assess whether the alt text is meaningful, whether content flows logically, or whether the overall experience is usable.

Keep exploring

Find another idea for the decision in front of you.

The complete Reframo library is free to read. Explore another guide whenever you are ready.

Accessibility Testing Methods | Reframo